None
**Instruments Affected**: NIRSpec
Tested on CV3 data
The library imports relevant to this notebook are aready taken care of by importing PTT.
NOTE: This notebook assumes that the pipeline version to be tested is already installed and its environment is activated.
To be able to run this notebook you need to install nptt.
If all goes well you will be able to import PTT.
# Create a temporary directory to hold notebook output, and change the working directory to that directory.
from tempfile import TemporaryDirectory
import os
import shutil
data_dir = TemporaryDirectory()
os.chdir(data_dir.name)
import os
if 'CRDS_CACHE_TYPE' in os.environ:
if os.environ['CRDS_CACHE_TYPE'] == 'local':
os.environ['CRDS_PATH'] = os.path.join(os.environ['HOME'], 'crds', 'cache')
elif os.path.isdir(os.environ['CRDS_CACHE_TYPE']):
os.environ['CRDS_PATH'] = os.environ['CRDS_CACHE_TYPE']
print('CRDS cache location: {}'.format(os.environ['CRDS_PATH']))
CRDS cache location: /grp/crds/cache
import warnings
import psutil
from astropy.io import fits
# Only print a DeprecationWarning the first time it shows up, not every time.
with warnings.catch_warnings():
warnings.simplefilter("once", category=DeprecationWarning)
import jwst
from jwst.pipeline.calwebb_detector1 import Detector1Pipeline
from jwst.assign_wcs.assign_wcs_step import AssignWcsStep
from jwst.msaflagopen.msaflagopen_step import MSAFlagOpenStep
from jwst.extract_2d.extract_2d_step import Extract2dStep
from jwst.srctype.srctype_step import SourceTypeStep
from jwst.wavecorr.wavecorr_step import WavecorrStep
from jwst.flatfield.flat_field_step import FlatFieldStep
from jwst.pathloss.pathloss_step import PathLossStep
from jwst import datamodels
# The latest version of NPTT is installed in the requirements text file at:
# /jwst_validation_notebooks/environment.yml
# import NPTT
import nirspec_pipe_testing_tool as nptt
# To get data from Artifactory
from ci_watson.artifactory_helpers import get_bigdata
2022-03-24 12:15:18,326 - stpipe - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/jwst/refpix/irs2_subtract_reference.py:4: DeprecationWarning: Please use `convolve1d` from the `scipy.ndimage` namespace, the `scipy.ndimage.filters` namespace is deprecated. from scipy.ndimage.filters import convolve1d 2022-03-24 12:15:18,344 - stpipe - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/tweakwcs/tpwcs.py:21: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead. if LooseVersion(gwcs.__version__) > '0.12.0': 2022-03-24 12:15:18,345 - stpipe - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/setuptools/_distutils/version.py:351: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead. other = LooseVersion(other) 2022-03-24 12:15:18,351 - stpipe - WARNING - /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/tweakwcs/wcsimage.py:26: DeprecationWarning: distutils Version classes are deprecated. Use packaging.version instead. if LooseVersion(gwcs.__version__) > '0.12.0':
# Make sure that the version used is the right one
pipeline_version = jwst.__version__
nptt_version = nptt.__version__
print("Using jwst pipeline version: ", pipeline_version)
print("Using NPTT version: ", nptt_version)
Using jwst pipeline version: 1.4.3 Using NPTT version: 1.1.24
The NIRSpec team developed an implementation of the pathloss step and compared the output to the pipeline output for this step. We expected machine precision differences (about 10^-7) but due to rounding differences in interpolation methods we relaxed the difference threshold to 10^-6.
For the test to be considered PASSED, every single slit (for FS data), slitlet (for MOS data) or slice (for IFU data) in the input file has to pass. If there is any failure, the whole test will be considered as FAILED.
The code for this test for Fixed Slits (FS) can be obtained from: https://github.com/spacetelescope/nirspec_pipe_testing_tool/blob/master/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/pathloss_fs_ps.py. There is a corresponding script for Multi Object Spectroscopy (MOS) and for Integral Field Unit (IFU) data. Each mode has a script for point source (ps) and for uniform source (uni).
Step description: https://jwst-pipeline.readthedocs.io/en/latest/jwst/pathloss/description.html
Pipeline code: https://github.com/spacetelescope/jwst/tree/master/jwst/pathloss
If the test PASSED this means that all slits, slitlets, or slices individually passed the test. However, if ony one individual slit (for FS data), slitlet (for MOS data) or slice (for IFU data) test failed, the whole test will be reported as FAILED.
A short description and link to the page: https://outerspace.stsci.edu/display/JWSTCC/Vanilla+Spectral+GWCS+Information
Acronymns used un this notebook:
pipeline: calibration pipeline
spec2: spectroscopic calibration pipeline level 2b
PTT: NIRSpec pipeline testing tool (https://github.com/spacetelescope/nirspec_pipe_testing_tool)
The pipeline can be run from the command line in two variants: full or per step.
Tu run the spec2 pipeline in full use the command:
$ strun jwst.pipeline.Spec2Pipeline jwtest_rate.fits
Tu only run the pathloss step, use the command:
$ strun jwst.pathloss.PathLossStep jwtest_previous_step_output.fits
These options are also callable from a script with the testing environment active. The Python call for running the pipeline in full or by step are:
$\gt$ from jwst.pipeline.calwebb_spec2 import Spec2Pipeline
$\gt$ Spec2Pipeline.call(jwtest_rate.fits)
or
$\gt$ from jwst.pathloss import PathLossStep
$\gt$ PathLossStep.call(jwtest_previous_step_output.fits)
PTT can run the spec2 pipeline either in full or per step, as well as the imaging pipeline in full. In this notebook we will use PTT to run the pipeline and the validation tests. To run PTT, follow the directions in the corresponding repo page.
All testing data is from the CV3 campaign. We chose these files because this is our most complete data set, i.e. all modes and filter-grating combinations.
Data used was for testing was only FS and MOS, since extract_2d is skipped for IFU. Data sets are:
testing_data = {'fs_prism_clear':{
'uncal_file_nrs1': 'fs_prism_nrs1_uncal.fits',
'uncal_file_nrs2': 'fs_prism_nrs2_uncal.fits',
'msa_shutter_config': None },
'fs_fullframe_g395h_f290lp':{
'uncal_file_nrs1': 'fs_fullframe_g395h_f290lp_nrs1_uncal.fits',
'uncal_file_nrs2': 'fs_fullframe_g395h_f290lp_nrs2_uncal.fits',
'msa_shutter_config': None },
# Commented out because wavecor is failing with this data set
#'fs_allslits_g140h_f100lp':{
# 'uncal_file_nrs1': 'fs_allslits_g140h_f100lp_nrs1_uncal.fits',
# 'uncal_file_nrs2': 'fs_allslits_g140h_f100lp_nrs2_uncal.fits',
# 'msa_shutter_config': None },
# Commented out because wavecor is not populating array
#'bots_g235h_f170lp':{
# 'uncal_file_nrs1': 'bots_g235h_f170lp_nrs1_uncal.fits',
# 'uncal_file_nrs2': 'bots_g235h_f170lp_nrs2_uncal.fits',
# 'msa_shutter_config': None },
'mos_prism_clear':{
'uncal_file_nrs1': 'mos_prism_nrs1_uncal.fits',
'uncal_file_nrs2': 'mos_prism_nrs2_uncal.fits',
'msa_shutter_config': 'V0030006000104_msa.fits' },
'mos_g140m_f100lp':{
'uncal_file_nrs1': 'mos_g140m_line1_NRS1_uncal.fits',
'uncal_file_nrs2': 'mos_g140m_line1_NRS2_uncal.fits',
'msa_shutter_config': 'V8460001000101_msa.fits' },
'ifu_prism_clear':{
'uncal_file_nrs1': 'ifu_prism_nrs1_uncal.fits',
'uncal_file_nrs2': 'ifu_prism_nrs2_uncal.fits',
'msa_shutter_config': None },
'ifu_g395h_f290lp':{
'uncal_file_nrs1': 'ifu_g395h_f290lp_nrs1_uncal.fits',
'uncal_file_nrs2': 'ifu_g395h_f290lp_nrs2_uncal.fits',
'msa_shutter_config': None }
}
# define function to pull data from Artifactory
def get_artifactory_file(data_set_dict, detector):
"""This function creates a list with all the files needed per detector to run the test.
Args:
data_set_dict: dictionary, contains inputs for a specific mode and configuration
detector: string, either nrs1 or nrs2
Returns:
data: list, contains all files needed to run test
"""
files2obtain = ['uncal_file_nrs1', 'msa_shutter_config']
data = []
for file in files2obtain:
data_file = None
try:
if '_nrs' in file and '2' in detector:
file = file.replace('_nrs1', '_nrs2')
data_file = get_bigdata('jwst_validation_notebooks',
'validation_data',
'nirspec_data',
data_set_dict[file])
except TypeError:
data.append(None)
continue
data.append(data_file)
return data
# Set common NPTT switches for this test
# accepted threshold difference with respect to benchmark files
threshold_diff = 9.999e-05
# other NPTT variables
writefile = False
show_figs = True
save_figs = False
# Get the data
detectors = ['nrs1', 'nrs2']
results_dict = {}
for mode_config, data_set_dict in testing_data.items():
for det in detectors:
print('Testing files for detector: ', det)
data = get_artifactory_file(data_set_dict, det)
uncal_file, msa_shutter_config = data
print('Working with uncal_file: ', uncal_file)
uncal_basename = os.path.basename(uncal_file)
# Run the stage 1 pipeline
rate_object = Detector1Pipeline.call(uncal_file)
# Make sure the MSA shutter configuration file is set up correctly
rate_object.meta.instrument.msa_metadata_file = msa_shutter_config
if msa_shutter_config is not None:
msa_metadata = rate_object.meta.instrument.msa_metadata_file
print('MSA shutter configuration file: ', msa_metadata)
if msa_metadata is None or msa_metadata == 'N/A':
rate_object.meta.instrument.msa_metadata_file = msa_shutter_config
# Run the stage 2 pipeline steps
try:
pipe_object = AssignWcsStep.call(rate_object)
skip_file = False
except:
print('An error occurred that made the pipeline crash, probably: No open slits fall on detector ', det)
print("Skipping test for this file. \n")
skip_file = True
if not skip_file:
if 'ifu' in uncal_basename.lower() or 'mos' in uncal_basename.lower():
pipe_object = MSAFlagOpenStep.call(pipe_object)
if 'ifu' not in uncal_basename.lower():
pipe_object = Extract2dStep.call(pipe_object)
pipe_object = SourceTypeStep.call(pipe_object)
pipe_object = WavecorrStep.call(pipe_object)
flat_field_object = FlatFieldStep.call(pipe_object)
pathloss_object = PathLossStep.call(flat_field_object)
# get the corresponding reference file from the pathloss datamodel
reffile_path = pathloss_object.meta.ref_file.pathloss.name.replace("crds://",
"https://jwst-crds.stsci.edu/unchecked_get/references/jwst/")
# Run the validation test
%matplotlib inline
if 'fs' in uncal_file.lower():
print('Running test for FS...')
source_type = pathloss_object.meta.target.source_type
if source_type == 'POINT' or source_type is None:
median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_fs_ps.pathtest(
flat_field_object,
reffile_path,
pathloss_object,
writefile=writefile,
show_figs=show_figs,
save_figs=save_figs,
threshold_diff=threshold_diff)
else:
median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_fs_uni.pathtest(
flat_field_object,
reffile_path,
pathloss_object,
writefile=writefile,
show_figs=show_figs,
save_figs=save_figs,
threshold_diff=threshold_diff)
if 'mos' in uncal_file.lower():
print('Running test for MOS...')
median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_mos.pathtest(
flat_field_object,
reffile_path,
pathloss_object,
writefile=writefile,
show_figs=show_figs,
save_figs=save_figs,
threshold_diff=threshold_diff)
if 'ifu' in uncal_file.lower():
print('Running test for IFU...')
if pathloss_object.meta.target.source_type == 'POINT':
median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_ifu_ps.pathtest(
flat_field_object,
reffile_path,
pathloss_object,
writefile=writefile,
show_figs=show_figs,
save_figs=save_figs,
threshold_diff=threshold_diff)
else:
median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_ifu_uni.pathtest(
flat_field_object,
reffile_path,
pathloss_object,
writefile=writefile,
show_figs=show_figs,
save_figs=save_figs,
threshold_diff=threshold_diff)
else:
result_msg = 'skipped'
# Did the test passed
print("Did pathloss validation test passed? ", result_msg, "\n\n")
rd = {uncal_basename: result_msg}
results_dict.update(rd)
# close all open files
psutil.Process().open_files()
closing_files = []
for fd in psutil.Process().open_files():
if data_dir.name in fd.path:
closing_files.append(fd)
for fd in closing_files:
try:
print('Closing file: ', fd)
open(fd.fd).close()
except:
print('File already closed: ', fd)
Testing files for detector: nrs1 Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_prism_nrs1_uncal.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.instrument.fixed_slit the following error occurred:
'FULL' is not one of ['S200A1', 'S200A2', 'S200B1', 'S400A1', 'S1600A1', 'NONE']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Name of fixed slit aperture used'),
('type', 'string'),
('enum',
['S200A1',
'S200A2',
'S200B1',
'S400A1',
'S1600A1',
'NONE']),
('fits_keyword', 'FXD_SLIT'),
('blend_table', True)])
On instance:
'FULL'
warnings.warn(errmsg, ValidationWarning)
2022-03-24 12:15:21,071 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:15:21,074 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:15:21,076 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:15:21,077 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:15:21,078 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:15:21,079 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:15:21,080 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:15:21,081 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:15:21,082 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:15:21,083 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:15:21,084 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:15:21,085 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:15:21,086 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:15:21,087 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:15:21,088 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:15:21,089 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:15:21,090 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
2022-03-24 12:15:21,269 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_prism_nrs1_uncal.fits',).
2022-03-24 12:15:21,278 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:15:21,452 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'fs_prism_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:15:21,460 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits'.
2022-03-24 12:15:21,462 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2022-03-24 12:15:21,463 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits'.
2022-03-24 12:15:21,464 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits'.
2022-03-24 12:15:21,465 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:15:21,466 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits'.
2022-03-24 12:15:21,467 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits'.
2022-03-24 12:15:21,468 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:15:21,469 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:15:21,469 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits'.
2022-03-24 12:15:21,470 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits'.
2022-03-24 12:15:21,472 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:15:21,472 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:15:21,473 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:15:21,865 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:15:21,866 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:15:22,005 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:15:22,006 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:15:22,008 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:15:22,149 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:15:22,150 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:15:22,171 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits
2022-03-24 12:15:22,589 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:15:22,738 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:15:22,740 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:15:22,760 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits
2022-03-24 12:15:23,611 - stpipe.Detector1Pipeline.saturation - INFO - Detected 9869 saturated pixels
2022-03-24 12:15:23,643 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:15:23,666 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:15:23,810 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:15:23,811 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:15:23,812 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:15:23,813 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:15:23,940 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:15:23,942 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:15:23,963 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-03-24 12:15:24,713 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:15:24,871 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:15:24,872 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:15:24,896 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits
2022-03-24 12:15:27,286 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-03-24 12:15:48,842 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:15:49,175 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:15:49,176 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:15:49,201 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits
2022-03-24 12:15:51,748 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:15:51,881 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:15:51,882 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:15:51,963 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits
2022-03-24 12:16:20,767 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=4, nframes=1, groupgap=0
2022-03-24 12:16:20,768 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-03-24 12:16:21,350 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:16:21,510 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:16:21,512 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:16:21,544 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:16:21,588 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-03-24 12:16:21,847 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-03-24 12:16:22,281 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:16:22,325 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:16:23,787 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from five groups.
2022-03-24 12:16:23,788 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 6540 pixels with at least one CR from four groups.
2022-03-24 12:16:23,789 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 139 pixels with at least one CR from three groups.
2022-03-24 12:16:24,443 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 2.16078 sec
2022-03-24 12:16:24,446 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 2.901526
2022-03-24 12:16:24,451 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:16:24,583 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:16:24,585 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:16:24,659 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-03-24 12:16:24,659 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-03-24 12:16:24,766 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:16:24,767 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:16:36,043 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 4
2022-03-24 12:16:36,044 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:16:36,235 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:16:36,383 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:16:36,384 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:16:36,449 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:16:36,450 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:16:36,454 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:16:36,556 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:16:36,557 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:16:36,624 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:16:36,624 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:16:36,628 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:16:36,630 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:16:36,632 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:16:36,641 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 12:16:36,747 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:16:36,749 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-03-24 12:16:36,917 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-03-24 12:16:36,918 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-03-24 12:16:36,918 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-03-24 12:16:36,919 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:16:37,350 - stpipe.AssignWcsStep - INFO - Removing slit S200B1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:16:37,351 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: ['S200A1', 'S200A2', 'S400A1', 'S1600A1']
2022-03-24 12:16:37,351 - stpipe.AssignWcsStep - INFO - Computing WCS for 4 open slitlets
2022-03-24 12:16:37,390 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-03-24 12:16:37,391 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-03-24 12:16:37,391 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-03-24 12:16:37,392 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:16:37,406 - stpipe.AssignWcsStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2022-03-24 12:16:37,580 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2022-03-24 12:16:37,581 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2022-03-24 12:16:37,581 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 3
2022-03-24 12:16:37,581 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 4
2022-03-24 12:16:37,582 - stpipe.AssignWcsStep - INFO - There are 4 open slits in quadrant 5
2022-03-24 12:16:37,781 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_fixedslit pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-03-24 12:16:38,157 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-03-24 12:16:38,170 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-03-24 12:16:38,179 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2022-03-24 12:16:38,296 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:16:38,297 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2022-03-24 12:16:38,312 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_FIXEDSLIT
2022-03-24 12:16:38,504 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A1
2022-03-24 12:16:38,505 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1083 1518
2022-03-24 12:16:38,505 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1057 1096
2022-03-24 12:16:38,707 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:16:38,716 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2022-03-24 12:16:38,717 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2022-03-24 12:16:38,889 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A2
2022-03-24 12:16:38,890 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 892 1328
2022-03-24 12:16:38,891 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1021 1060
2022-03-24 12:16:39,082 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:16:39,092 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2022-03-24 12:16:39,093 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2022-03-24 12:16:39,406 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S400A1
2022-03-24 12:16:39,407 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1025 1460
2022-03-24 12:16:39,407 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 980 1024
2022-03-24 12:16:39,601 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:16:39,609 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2022-03-24 12:16:39,611 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2022-03-24 12:16:39,779 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S1600A1
2022-03-24 12:16:39,780 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1056 1488
2022-03-24 12:16:39,780 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 960 982
2022-03-24 12:16:39,966 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:16:39,974 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2022-03-24 12:16:39,976 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2022-03-24 12:16:40,192 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2022-03-24 12:16:40,564 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2022-03-24 12:16:40,722 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:16:40,723 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:16:40,730 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_FIXEDSLIT
2022-03-24 12:16:40,731 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2022-03-24 12:16:40,731 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = POINT
2022-03-24 12:16:40,737 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2022-03-24 12:16:40,754 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2022-03-24 12:16:40,886 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:16:40,888 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:16:40,911 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0003.asdf
2022-03-24 12:16:41,594 - stpipe.WavecorrStep - WARNING - Primary slit name not found in input
2022-03-24 12:16:41,595 - stpipe.WavecorrStep - WARNING - Skipping wavecorr correction
2022-03-24 12:16:41,600 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2022-03-24 12:16:41,614 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2022-03-24 12:16:41,775 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:16:41,776 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-03-24 12:16:48,216 - stpipe.FlatFieldStep - INFO - Working on slit S200A1
2022-03-24 12:16:51,964 - stpipe.FlatFieldStep - INFO - Working on slit S200A2
2022-03-24 12:16:55,690 - stpipe.FlatFieldStep - INFO - Working on slit S400A1
2022-03-24 12:16:59,894 - stpipe.FlatFieldStep - INFO - Working on slit S1600A1
2022-03-24 12:17:02,044 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
2022-03-24 12:17:02,059 - stpipe.PathLossStep - INFO - PathLossStep instance created.
2022-03-24 12:17:02,224 - stpipe.PathLossStep - INFO - Step PathLossStep running with args (<MultiSlitModel from fs_prism_nrs1_uncal.fits>,).
2022-03-24 12:17:02,225 - stpipe.PathLossStep - INFO - Step PathLossStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-03-24 12:17:02,251 - stpipe.PathLossStep - INFO - Using PATHLOSS reference file /grp/crds/cache/references/jwst/jwst_nirspec_pathloss_0001.fits
2022-03-24 12:17:02,367 - stpipe.PathLossStep - INFO - Input exposure type is NRS_FIXEDSLIT
2022-03-24 12:17:03,073 - stpipe.PathLossStep - INFO - Working on slit S200A1
2022-03-24 12:17:03,074 - stpipe.PathLossStep - INFO - Using aperture S200A1
2022-03-24 12:17:03,100 - stpipe.PathLossStep - INFO - Working on slit S200A2
2022-03-24 12:17:03,101 - stpipe.PathLossStep - INFO - Using aperture S200A2
2022-03-24 12:17:03,126 - stpipe.PathLossStep - INFO - Working on slit S400A1
2022-03-24 12:17:03,127 - stpipe.PathLossStep - WARNING - Cannot find matching pathloss model for S400A1
2022-03-24 12:17:03,127 - stpipe.PathLossStep - WARNING - Skipping pathloss correction for this slit
2022-03-24 12:17:03,127 - stpipe.PathLossStep - WARNING - No correction provided for slit 2. Skipping
2022-03-24 12:17:03,128 - stpipe.PathLossStep - INFO - Working on slit S1600A1
2022-03-24 12:17:03,128 - stpipe.PathLossStep - INFO - Using aperture S1600A1
2022-03-24 12:17:03,157 - stpipe.PathLossStep - INFO - Step PathLossStep done
Running test for FS...
Checking if files exist and obtaining datamodels. This takes a few minutes...
from datamodel --> Detector: NRS1 Grating: PRISM Filter: CLEAR Lamp: LINE4 EXP_TYPE: NRS_FIXEDSLIT
Now looping through the slits. This may take a while...
Looping through the wavelengths...
Working with slitlet S200A1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
Calculating statistics...
Absolute Difference : mean = -1.096e-16 median = -2.220e-16 stdev = 3.665e-16
Maximum AbsoluteDifference = 8.882e-16
Minimum AbsoluteDifference = -4.441e-16
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
Working with slitlet S200A2
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/pathloss_fs_ps.py:304: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/.astropy/cache/download/url/aa0c667e23a747249d9442a76121955c/contents' mode='rb' closefd=True> hdul = fits.open(reffile2use)
<Figure size 432x288 with 0 Axes>
Calculating statistics...
Absolute Difference : mean = -1.122e-16 median = -2.220e-16 stdev = 3.646e-16
Maximum AbsoluteDifference = 8.882e-16
Minimum AbsoluteDifference = -4.441e-16
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
Working with slitlet S400A1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Unable to retrieve extension.
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
Pipeline pathloss correction in datamodel is empty. Skipping testing this slit.
Working with slitlet S1600A1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
<Figure size 432x288 with 0 Axes>
Calculating statistics...
Absolute Difference : mean = -1.288e-16 median = -2.220e-16 stdev = 1.365e-16
Maximum AbsoluteDifference = 2.220e-16
Minimum AbsoluteDifference = -2.220e-16
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
*** Final pathloss test result reported as PASSED ***
('* Script FS_PS.py took ', '2.1727176944414777 minutes to finish.')
Did pathloss validation test passed? All slits PASSED path_loss test.
Testing files for detector: nrs2
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/ipykernel_1159331/2294938804.py:64: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/.astropy/cache/download/url/aa0c667e23a747249d9442a76121955c/contents' mode='rb' closefd=True> median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_fs_ps.pathtest(
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_prism_nrs2_uncal.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.instrument.fixed_slit the following error occurred:
'FULL' is not one of ['S200A1', 'S200A2', 'S200B1', 'S400A1', 'S1600A1', 'NONE']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Name of fixed slit aperture used'),
('type', 'string'),
('enum',
['S200A1',
'S200A2',
'S200B1',
'S400A1',
'S1600A1',
'NONE']),
('fits_keyword', 'FXD_SLIT'),
('blend_table', True)])
On instance:
'FULL'
warnings.warn(errmsg, ValidationWarning)
2022-03-24 12:19:14,425 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:19:14,426 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:19:14,428 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:19:14,429 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:19:14,430 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:19:14,431 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:19:14,432 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:19:14,433 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:19:14,434 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:19:14,435 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:19:14,436 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:19:14,437 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:19:14,438 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:19:14,439 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:19:14,441 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:19:14,442 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:19:14,443 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_prism_nrs2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 12:19:14,858 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_prism_nrs2_uncal.fits',).
2022-03-24 12:19:14,868 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:19:15,044 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'fs_prism_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:19:15,052 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits'.
2022-03-24 12:19:15,053 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2022-03-24 12:19:15,055 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits'.
2022-03-24 12:19:15,056 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits'.
2022-03-24 12:19:15,058 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:19:15,058 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits'.
2022-03-24 12:19:15,059 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits'.
2022-03-24 12:19:15,061 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:19:15,061 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:19:15,062 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits'.
2022-03-24 12:19:15,063 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits'.
2022-03-24 12:19:15,064 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:19:15,064 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:19:15,065 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:19:15,657 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:19:15,658 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:19:15,810 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:19:15,810 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:19:15,813 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:19:16,151 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:19:16,152 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:19:16,177 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits
2022-03-24 12:19:16,694 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:19:17,038 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:19:17,039 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:19:17,062 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits
2022-03-24 12:19:18,213 - stpipe.Detector1Pipeline.saturation - INFO - Detected 5379 saturated pixels
2022-03-24 12:19:18,244 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:19:18,277 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:19:18,629 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:19:18,632 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:19:18,632 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:19:18,635 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:19:18,982 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:19:18,984 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:19:19,011 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-03-24 12:19:22,589 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:19:22,943 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:19:22,945 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:19:22,970 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits
2022-03-24 12:19:25,081 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-03-24 12:19:46,454 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:19:46,958 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:19:46,960 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:19:46,987 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits
2022-03-24 12:19:50,594 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:19:50,817 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:19:50,818 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:19:50,886 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits
2022-03-24 12:20:23,832 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=4, nframes=1, groupgap=0
2022-03-24 12:20:23,833 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-03-24 12:20:24,398 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:20:24,606 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:20:24,608 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:20:24,636 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:20:24,680 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-03-24 12:20:25,110 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-03-24 12:20:26,245 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:20:26,287 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:20:27,711 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from five groups.
2022-03-24 12:20:27,711 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 3051 pixels with at least one CR from four groups.
2022-03-24 12:20:27,712 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 3 pixels with at least one CR from three groups.
2022-03-24 12:20:28,045 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 1.79939 sec
2022-03-24 12:20:28,048 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 3.412682
2022-03-24 12:20:28,054 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:20:28,257 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 4, 3200, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:20:28,259 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:20:28,356 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-03-24 12:20:28,356 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-03-24 12:20:28,465 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:20:28,466 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:20:39,505 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 4
2022-03-24 12:20:39,505 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:20:39,696 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:20:39,891 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:20:39,893 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:20:39,959 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:20:39,960 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:20:39,964 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:20:40,157 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:20:40,159 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:20:40,228 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:20:40,228 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:20:40,232 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:20:40,234 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:20:40,236 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:20:40,245 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 12:20:40,443 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:20:40,445 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-03-24 12:20:40,614 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-03-24 12:20:40,615 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-03-24 12:20:40,615 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-03-24 12:20:40,616 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:20:40,825 - stpipe.AssignWcsStep - INFO - Removing slit S200A1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:20:40,863 - stpipe.AssignWcsStep - INFO - Removing slit S200A2 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:20:40,900 - stpipe.AssignWcsStep - INFO - Removing slit S400A1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:20:40,940 - stpipe.AssignWcsStep - INFO - Removing slit S1600A1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:20:40,977 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: ['S200B1']
2022-03-24 12:20:40,978 - stpipe.AssignWcsStep - INFO - Computing WCS for 1 open slitlets
2022-03-24 12:20:41,015 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-03-24 12:20:41,015 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-03-24 12:20:41,016 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-03-24 12:20:41,017 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:20:41,031 - stpipe.AssignWcsStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2022-03-24 12:20:41,180 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2022-03-24 12:20:41,180 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2022-03-24 12:20:41,181 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 3
2022-03-24 12:20:41,181 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 4
2022-03-24 12:20:41,181 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 5
2022-03-24 12:20:41,334 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_fixedslit pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-03-24 12:20:41,509 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-03-24 12:20:41,522 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-03-24 12:20:41,531 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2022-03-24 12:20:41,750 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:20:41,752 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2022-03-24 12:20:41,768 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_FIXEDSLIT
2022-03-24 12:20:41,916 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200B1
2022-03-24 12:20:41,917 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 440 864
2022-03-24 12:20:41,917 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 919 962
2022-03-24 12:20:42,110 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:20:42,119 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.238745821 -45.653926065 156.237887188 -45.653118339 156.237822146 -45.653151380 156.238680762 -45.653959111
2022-03-24 12:20:42,120 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.238745821 -45.653926065 156.237887188 -45.653118339 156.237822146 -45.653151380 156.238680762 -45.653959111
2022-03-24 12:20:42,178 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2022-03-24 12:20:42,189 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2022-03-24 12:20:42,382 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:20:42,383 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:20:42,390 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_FIXEDSLIT
2022-03-24 12:20:42,391 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2022-03-24 12:20:42,391 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = POINT
2022-03-24 12:20:42,395 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2022-03-24 12:20:42,405 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2022-03-24 12:20:42,598 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:20:42,599 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:20:42,618 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0003.asdf
2022-03-24 12:20:42,849 - stpipe.WavecorrStep - WARNING - Primary slit name not found in input
2022-03-24 12:20:42,850 - stpipe.WavecorrStep - WARNING - Skipping wavecorr correction
2022-03-24 12:20:42,854 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2022-03-24 12:20:42,866 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2022-03-24 12:20:43,075 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:20:43,076 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-03-24 12:20:49,497 - stpipe.FlatFieldStep - INFO - Working on slit S200B1
2022-03-24 12:20:53,150 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
2022-03-24 12:20:53,162 - stpipe.PathLossStep - INFO - PathLossStep instance created.
2022-03-24 12:20:53,378 - stpipe.PathLossStep - INFO - Step PathLossStep running with args (<MultiSlitModel from fs_prism_nrs2_uncal.fits>,).
2022-03-24 12:20:53,379 - stpipe.PathLossStep - INFO - Step PathLossStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-03-24 12:20:53,398 - stpipe.PathLossStep - INFO - Using PATHLOSS reference file /grp/crds/cache/references/jwst/jwst_nirspec_pathloss_0001.fits
2022-03-24 12:20:53,493 - stpipe.PathLossStep - INFO - Input exposure type is NRS_FIXEDSLIT
2022-03-24 12:20:53,729 - stpipe.PathLossStep - INFO - Working on slit S200B1
2022-03-24 12:20:53,729 - stpipe.PathLossStep - INFO - Using aperture S200B1
2022-03-24 12:20:53,759 - stpipe.PathLossStep - INFO - Step PathLossStep done
Running test for FS...
Checking if files exist and obtaining datamodels. This takes a few minutes...
from datamodel --> Detector: NRS2 Grating: PRISM Filter: CLEAR Lamp: LINE4 EXP_TYPE: NRS_FIXEDSLIT
Now looping through the slits. This may take a while...
Looping through the wavelengths...
Working with slitlet S200B1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
Calculating statistics...
Absolute Difference : mean = -1.143e-16 median = -2.220e-16 stdev = 3.639e-16
Maximum AbsoluteDifference = 8.882e-16
Minimum AbsoluteDifference = -4.441e-16
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
*** Final pathloss test result reported as PASSED ***
('* Script FS_PS.py took ', '43.463318824768066 seconds to finish.')
Did pathloss validation test passed? All slits PASSED path_loss test.
Testing files for detector: nrs1
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/ipykernel_1159331/2294938804.py:64: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/.astropy/cache/download/url/aa0c667e23a747249d9442a76121955c/contents' mode='rb' closefd=True> median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_fs_ps.pathtest(
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_fullframe_g395h_f290lp_nrs1_uncal.fits
2022-03-24 12:21:39,347 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:21:39,348 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:21:39,349 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:21:39,350 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:21:39,351 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:21:39,352 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:21:39,353 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:21:39,354 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:21:39,355 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:21:39,356 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:21:39,357 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:21:39,358 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:21:39,359 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:21:39,360 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:21:39,361 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:21:39,363 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:21:39,364 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_fullframe_g395h_f290lp_nrs1_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 12:21:39,590 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_fullframe_g395h_f290lp_nrs1_uncal.fits',).
2022-03-24 12:21:39,599 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:21:39,791 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'fs_fullframe_g395h_f290lp_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:21:39,798 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits'.
2022-03-24 12:21:39,800 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2022-03-24 12:21:39,801 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits'.
2022-03-24 12:21:39,802 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits'.
2022-03-24 12:21:39,803 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:21:39,804 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits'.
2022-03-24 12:21:39,805 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits'.
2022-03-24 12:21:39,806 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:21:39,806 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:21:39,807 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits'.
2022-03-24 12:21:39,808 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits'.
2022-03-24 12:21:39,809 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:21:39,809 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:21:39,810 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:21:40,240 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:21:40,241 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:21:40,374 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:21:40,374 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:21:40,377 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:21:40,545 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:21:40,547 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:21:40,567 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits
2022-03-24 12:21:40,970 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:21:41,136 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:21:41,138 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:21:41,159 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits
2022-03-24 12:21:41,964 - stpipe.Detector1Pipeline.saturation - INFO - Detected 11377 saturated pixels
2022-03-24 12:21:42,020 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:21:42,044 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:21:42,212 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:21:42,213 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:21:42,214 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:21:42,216 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:21:42,373 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:21:42,374 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:21:42,396 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-03-24 12:21:42,857 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:21:43,037 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:21:43,039 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:21:43,061 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits
2022-03-24 12:21:43,460 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-03-24 12:22:05,648 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:22:05,895 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:05,897 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:22:05,919 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits
2022-03-24 12:22:06,804 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:22:06,970 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:06,971 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:22:07,061 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits
2022-03-24 12:22:09,926 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=7, nframes=1, groupgap=0
2022-03-24 12:22:09,927 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-03-24 12:22:10,634 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:22:10,817 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:10,818 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:22:10,862 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:22:10,909 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-03-24 12:22:11,025 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-03-24 12:22:11,354 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:22:11,422 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:22:14,011 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 38615 pixels with at least one CR from five groups.
2022-03-24 12:22:14,012 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 106 pixels with at least one CR from four groups.
2022-03-24 12:22:14,012 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 154 pixels with at least one CR from three groups.
2022-03-24 12:22:20,397 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 9.04167 sec
2022-03-24 12:22:20,400 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 9.537972
2022-03-24 12:22:20,405 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:22:20,576 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:20,577 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:22:20,685 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-03-24 12:22:20,685 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-03-24 12:22:20,791 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:22:20,792 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:22:47,449 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 7
2022-03-24 12:22:47,450 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:22:47,621 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:22:47,785 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:47,787 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:22:47,855 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:22:47,856 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:22:47,860 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:22:48,024 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:48,025 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:22:48,095 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:22:48,096 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:22:48,100 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:22:48,101 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:22:48,103 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:22:48,112 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 12:22:48,275 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:48,276 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-03-24 12:22:48,440 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-03-24 12:22:48,441 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-03-24 12:22:48,441 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-03-24 12:22:48,443 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:22:48,707 - stpipe.AssignWcsStep - INFO - Removing slit S200B1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:22:48,708 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: ['S200A1', 'S200A2', 'S400A1', 'S1600A1']
2022-03-24 12:22:48,708 - stpipe.AssignWcsStep - INFO - Computing WCS for 4 open slitlets
2022-03-24 12:22:48,744 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-03-24 12:22:48,744 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-03-24 12:22:48,745 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-03-24 12:22:48,746 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:22:48,759 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2022-03-24 12:22:48,907 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2022-03-24 12:22:48,907 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2022-03-24 12:22:48,908 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 3
2022-03-24 12:22:48,908 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 4
2022-03-24 12:22:48,908 - stpipe.AssignWcsStep - INFO - There are 4 open slits in quadrant 5
2022-03-24 12:22:49,088 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_fixedslit pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-03-24 12:22:49,321 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-03-24 12:22:49,333 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-03-24 12:22:49,342 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2022-03-24 12:22:49,529 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:49,531 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2022-03-24 12:22:49,546 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_FIXEDSLIT
2022-03-24 12:22:49,732 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A1
2022-03-24 12:22:49,733 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 823 2048
2022-03-24 12:22:49,733 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1061 1106
2022-03-24 12:22:49,941 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:22:49,950 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2022-03-24 12:22:49,951 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2022-03-24 12:22:50,125 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A2
2022-03-24 12:22:50,126 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 633 2048
2022-03-24 12:22:50,126 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1024 1071
2022-03-24 12:22:50,342 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:22:50,350 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2022-03-24 12:22:50,351 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2022-03-24 12:22:50,716 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S400A1
2022-03-24 12:22:50,716 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 751 2048
2022-03-24 12:22:50,717 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 985 1035
2022-03-24 12:22:50,933 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:22:50,941 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2022-03-24 12:22:50,942 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2022-03-24 12:22:51,105 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S1600A1
2022-03-24 12:22:51,106 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 774 2048
2022-03-24 12:22:51,106 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 965 992
2022-03-24 12:22:51,302 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:22:51,311 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2022-03-24 12:22:51,312 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2022-03-24 12:22:51,521 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2022-03-24 12:22:51,540 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2022-03-24 12:22:51,735 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:51,736 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:22:51,743 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_FIXEDSLIT
2022-03-24 12:22:51,743 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2022-03-24 12:22:51,744 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = POINT
2022-03-24 12:22:51,750 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2022-03-24 12:22:51,764 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2022-03-24 12:22:51,933 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:51,934 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:22:51,957 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0003.asdf
2022-03-24 12:22:52,631 - stpipe.WavecorrStep - INFO - Detected a POINT source type in slit S200A1
2022-03-24 12:22:52,632 - stpipe.WavecorrStep - INFO - slit name S200A1
2022-03-24 12:22:52,633 - stpipe.WavecorrStep - INFO - xoffset, yoffset, 0.0, 0.0
2022-03-24 12:22:52,643 - stpipe.WavecorrStep - INFO - Source X/Y position in the slit: -47.64797908201603, 111.43696289948753
2022-03-24 12:22:52,790 - stpipe.WavecorrStep - INFO - Using wavelength zero-point correction for aperture S200A1
2022-03-24 12:22:52,802 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2022-03-24 12:22:52,818 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2022-03-24 12:22:53,029 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:22:53,030 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-03-24 12:22:55,437 - stpipe.FlatFieldStep - INFO - Working on slit S200A1
2022-03-24 12:22:55,438 - stpipe.FlatFieldStep - INFO - Creating wavelength array from WCS for slit S200A1
2022-03-24 12:23:15,750 - stpipe.FlatFieldStep - INFO - Working on slit S200A2
2022-03-24 12:23:27,316 - stpipe.FlatFieldStep - INFO - Working on slit S400A1
2022-03-24 12:23:39,387 - stpipe.FlatFieldStep - INFO - Working on slit S1600A1
2022-03-24 12:23:44,833 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
2022-03-24 12:23:44,848 - stpipe.PathLossStep - INFO - PathLossStep instance created.
2022-03-24 12:23:45,037 - stpipe.PathLossStep - INFO - Step PathLossStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:23:45,038 - stpipe.PathLossStep - INFO - Step PathLossStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-03-24 12:23:45,062 - stpipe.PathLossStep - INFO - Using PATHLOSS reference file /grp/crds/cache/references/jwst/jwst_nirspec_pathloss_0001.fits
2022-03-24 12:23:45,156 - stpipe.PathLossStep - INFO - Input exposure type is NRS_FIXEDSLIT
2022-03-24 12:23:45,839 - stpipe.PathLossStep - INFO - Working on slit S200A1
2022-03-24 12:23:45,840 - stpipe.PathLossStep - INFO - Using aperture S200A1
2022-03-24 12:23:45,840 - stpipe.PathLossStep - WARNING - Source is outside slit. Skipping pathloss correction for slit S200A1
2022-03-24 12:23:45,841 - stpipe.PathLossStep - WARNING - No correction provided for slit 0. Skipping
2022-03-24 12:23:45,841 - stpipe.PathLossStep - INFO - Working on slit S200A2
2022-03-24 12:23:45,841 - stpipe.PathLossStep - INFO - Using aperture S200A2
2022-03-24 12:23:45,870 - stpipe.PathLossStep - INFO - Working on slit S400A1
2022-03-24 12:23:45,870 - stpipe.PathLossStep - WARNING - Cannot find matching pathloss model for S400A1
2022-03-24 12:23:45,871 - stpipe.PathLossStep - WARNING - Skipping pathloss correction for this slit
2022-03-24 12:23:45,871 - stpipe.PathLossStep - WARNING - No correction provided for slit 2. Skipping
2022-03-24 12:23:45,871 - stpipe.PathLossStep - INFO - Working on slit S1600A1
2022-03-24 12:23:45,872 - stpipe.PathLossStep - INFO - Using aperture S1600A1
2022-03-24 12:23:45,903 - stpipe.PathLossStep - INFO - Step PathLossStep done
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/pathloss_fs_ps.py:304: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/.astropy/cache/download/url/aa0c667e23a747249d9442a76121955c/contents' mode='rb' closefd=True>
hdul = fits.open(reffile2use)
Running test for FS...
Checking if files exist and obtaining datamodels. This takes a few minutes...
from datamodel --> Detector: NRS1 Grating: G395H Filter: F290LP Lamp: LINE3 EXP_TYPE: NRS_FIXEDSLIT
Now looping through the slits. This may take a while...
Looping through the wavelengths...
Working with slitlet S200A1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
Pipeline pathloss correction in datamodel is empty. Skipping testing this slit.
Working with slitlet S200A2
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
Calculating statistics...
Absolute Difference : mean = -1.848e-16 median = -2.220e-16 stdev = 1.074e-16
Maximum AbsoluteDifference = 0.000e+00
Minimum AbsoluteDifference = -4.441e-16
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
Working with slitlet S400A1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Unable to retrieve extension.
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
Pipeline pathloss correction in datamodel is empty. Skipping testing this slit.
Working with slitlet S1600A1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
<Figure size 432x288 with 0 Axes>
Calculating statistics...
Absolute Difference : mean = -1.084e-16 median = 0.000e+00 stdev = 1.110e-16
Maximum AbsoluteDifference = 0.000e+00
Minimum AbsoluteDifference = -2.220e-16
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
*** Final pathloss test result reported as PASSED ***
('* Script FS_PS.py took ', '1.437476146221161 minutes to finish.')
Did pathloss validation test passed? All slits PASSED path_loss test.
Testing files for detector: nrs2
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/ipykernel_1159331/2294938804.py:64: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/.astropy/cache/download/url/aa0c667e23a747249d9442a76121955c/contents' mode='rb' closefd=True> median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_fs_ps.pathtest(
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_fullframe_g395h_f290lp_nrs2_uncal.fits
2022-03-24 12:25:13,917 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:25:13,918 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:25:13,919 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:25:13,921 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:25:13,921 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:25:13,922 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:25:13,923 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:25:13,924 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:25:13,925 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:25:13,927 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:25:13,928 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:25:13,928 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:25:13,929 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:25:13,931 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:25:13,932 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:25:13,933 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:25:13,934 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_fullframe_g395h_f290lp_nrs2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 12:25:14,164 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/fs_fullframe_g395h_f290lp_nrs2_uncal.fits',).
2022-03-24 12:25:14,173 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:25:14,356 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'fs_fullframe_g395h_f290lp_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:25:14,364 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits'.
2022-03-24 12:25:14,365 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2022-03-24 12:25:14,367 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits'.
2022-03-24 12:25:14,368 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits'.
2022-03-24 12:25:14,369 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:25:14,370 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits'.
2022-03-24 12:25:14,371 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits'.
2022-03-24 12:25:14,373 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:25:14,373 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:25:14,373 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits'.
2022-03-24 12:25:14,374 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits'.
2022-03-24 12:25:14,376 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:25:14,376 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:25:14,376 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:25:14,808 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:25:14,809 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:25:14,940 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:25:14,941 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:25:14,943 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:25:15,125 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:25:15,126 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:25:15,147 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits
2022-03-24 12:25:15,553 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:25:15,731 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:25:15,732 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:25:15,753 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits
2022-03-24 12:25:16,649 - stpipe.Detector1Pipeline.saturation - INFO - Detected 6420 saturated pixels
2022-03-24 12:25:16,704 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:25:16,728 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:25:16,905 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:25:16,907 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:25:16,907 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:25:16,909 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:25:17,075 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:25:17,076 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:25:17,098 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-03-24 12:25:17,844 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:25:18,025 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:25:18,026 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:25:18,048 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits
2022-03-24 12:25:18,977 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-03-24 12:25:41,409 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:25:41,687 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:25:41,688 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:25:41,711 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits
2022-03-24 12:25:43,187 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:25:43,370 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:25:43,371 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:25:43,464 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits
2022-03-24 12:25:59,424 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=7, nframes=1, groupgap=0
2022-03-24 12:25:59,425 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-03-24 12:26:00,046 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:26:00,245 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:26:00,246 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:26:00,292 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:26:00,342 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-03-24 12:26:00,530 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-03-24 12:26:00,950 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:26:01,016 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:26:03,588 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 20878 pixels with at least one CR from five groups.
2022-03-24 12:26:03,589 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 13 pixels with at least one CR from four groups.
2022-03-24 12:26:03,589 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 5 pixels with at least one CR from three groups.
2022-03-24 12:26:07,123 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 6.17225 sec
2022-03-24 12:26:07,126 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 6.833969
2022-03-24 12:26:07,132 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:26:07,312 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 7, 3200, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:26:07,314 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:26:07,420 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-03-24 12:26:07,420 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-03-24 12:26:07,526 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:26:07,526 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:26:33,508 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 7
2022-03-24 12:26:33,509 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:26:33,673 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:26:33,857 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:26:33,858 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:26:33,928 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:26:33,929 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:26:33,933 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:26:34,119 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:26:34,120 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:26:34,188 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:26:34,189 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:26:34,193 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:26:34,195 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:26:34,196 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:26:34,205 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 12:26:34,386 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:26:34,387 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-03-24 12:26:34,556 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-03-24 12:26:34,557 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-03-24 12:26:34,557 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-03-24 12:26:34,559 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:26:34,854 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: ['S200A1', 'S200A2', 'S400A1', 'S1600A1', 'S200B1']
2022-03-24 12:26:34,855 - stpipe.AssignWcsStep - INFO - Computing WCS for 5 open slitlets
2022-03-24 12:26:34,891 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-03-24 12:26:34,891 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-03-24 12:26:34,892 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-03-24 12:26:34,893 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:26:34,906 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2022-03-24 12:26:35,059 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2022-03-24 12:26:35,060 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2022-03-24 12:26:35,060 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 3
2022-03-24 12:26:35,060 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 4
2022-03-24 12:26:35,061 - stpipe.AssignWcsStep - INFO - There are 5 open slits in quadrant 5
2022-03-24 12:26:35,249 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_fixedslit pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None}
2022-03-24 12:26:35,506 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-03-24 12:26:35,519 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-03-24 12:26:35,527 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2022-03-24 12:26:35,751 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:26:35,753 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2022-03-24 12:26:35,768 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_FIXEDSLIT
2022-03-24 12:26:35,985 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A1
2022-03-24 12:26:35,986 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 2048
2022-03-24 12:26:35,986 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1061 1118
2022-03-24 12:26:36,246 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:26:36,260 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2022-03-24 12:26:36,262 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191685737 -45.682908511 156.190837415 -45.682092120 156.190771015 -45.682126390 156.191619323 -45.682942792
2022-03-24 12:26:36,496 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200A2
2022-03-24 12:26:36,497 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 2048
2022-03-24 12:26:36,497 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1024 1081
2022-03-24 12:26:36,762 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:26:36,770 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2022-03-24 12:26:36,771 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.184519149 -45.685298792 156.183675453 -45.684484578 156.183609578 -45.684518640 156.184453260 -45.685332865
2022-03-24 12:26:36,983 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S400A1
2022-03-24 12:26:36,984 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 2048
2022-03-24 12:26:36,984 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 985 1046
2022-03-24 12:26:37,489 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:26:37,497 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2022-03-24 12:26:37,499 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187759056 -45.682331806 156.186793281 -45.681401531 156.186663358 -45.681468621 156.187629101 -45.682398919
2022-03-24 12:26:37,693 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S1600A1
2022-03-24 12:26:37,693 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 2048
2022-03-24 12:26:37,694 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 965 1004
2022-03-24 12:26:37,929 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:26:37,938 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2022-03-24 12:26:37,939 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187720636 -45.680802803 156.187307671 -45.680405209 156.186792650 -45.680671077 156.187205560 -45.681068709
2022-03-24 12:26:38,177 - stpipe.Extract2dStep - INFO - Name of subarray extracted: S200B1
2022-03-24 12:26:38,178 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 140 2048
2022-03-24 12:26:38,178 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 926 982
2022-03-24 12:26:38,434 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:26:38,443 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.238745821 -45.653926065 156.237887188 -45.653118339 156.237822146 -45.653151380 156.238680762 -45.653959111
2022-03-24 12:26:38,444 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.238745821 -45.653926065 156.237887188 -45.653118339 156.237822146 -45.653151380 156.238680762 -45.653959111
2022-03-24 12:26:38,710 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2022-03-24 12:26:38,815 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2022-03-24 12:26:39,056 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:26:39,057 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:26:39,064 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_FIXEDSLIT
2022-03-24 12:26:39,065 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2022-03-24 12:26:39,065 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = POINT
2022-03-24 12:26:39,073 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2022-03-24 12:26:39,090 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2022-03-24 12:26:39,275 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:26:39,276 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:26:39,301 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0003.asdf
2022-03-24 12:26:40,147 - stpipe.WavecorrStep - INFO - Detected a POINT source type in slit S200A1
2022-03-24 12:26:40,148 - stpipe.WavecorrStep - INFO - slit name S200A1
2022-03-24 12:26:40,149 - stpipe.WavecorrStep - INFO - xoffset, yoffset, 0.0, 0.0
2022-03-24 12:26:40,160 - stpipe.WavecorrStep - INFO - Source X/Y position in the slit: -47.64797908201603, 111.43696289948753
2022-03-24 12:26:40,386 - stpipe.WavecorrStep - INFO - Using wavelength zero-point correction for aperture S200A1
2022-03-24 12:26:40,403 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2022-03-24 12:26:40,420 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2022-03-24 12:26:40,664 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:26:40,666 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-03-24 12:26:45,172 - stpipe.FlatFieldStep - INFO - Working on slit S200A1
2022-03-24 12:26:45,173 - stpipe.FlatFieldStep - INFO - Creating wavelength array from WCS for slit S200A1
2022-03-24 12:27:19,284 - stpipe.FlatFieldStep - INFO - Working on slit S200A2
2022-03-24 12:27:36,474 - stpipe.FlatFieldStep - INFO - Working on slit S400A1
2022-03-24 12:27:55,092 - stpipe.FlatFieldStep - INFO - Working on slit S1600A1
2022-03-24 12:28:03,744 - stpipe.FlatFieldStep - INFO - Working on slit S200B1
2022-03-24 12:28:19,843 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
2022-03-24 12:28:19,861 - stpipe.PathLossStep - INFO - PathLossStep instance created.
2022-03-24 12:28:20,130 - stpipe.PathLossStep - INFO - Step PathLossStep running with args (<MultiSlitModel from fs_fullframe_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 12:28:20,132 - stpipe.PathLossStep - INFO - Step PathLossStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-03-24 12:28:20,160 - stpipe.PathLossStep - INFO - Using PATHLOSS reference file /grp/crds/cache/references/jwst/jwst_nirspec_pathloss_0001.fits
2022-03-24 12:28:20,261 - stpipe.PathLossStep - INFO - Input exposure type is NRS_FIXEDSLIT
2022-03-24 12:28:21,127 - stpipe.PathLossStep - INFO - Working on slit S200A1
2022-03-24 12:28:21,128 - stpipe.PathLossStep - INFO - Using aperture S200A1
2022-03-24 12:28:21,128 - stpipe.PathLossStep - WARNING - Source is outside slit. Skipping pathloss correction for slit S200A1
2022-03-24 12:28:21,128 - stpipe.PathLossStep - WARNING - No correction provided for slit 0. Skipping
2022-03-24 12:28:21,129 - stpipe.PathLossStep - INFO - Working on slit S200A2
2022-03-24 12:28:21,129 - stpipe.PathLossStep - INFO - Using aperture S200A2
2022-03-24 12:28:21,160 - stpipe.PathLossStep - INFO - Working on slit S400A1
2022-03-24 12:28:21,161 - stpipe.PathLossStep - WARNING - Cannot find matching pathloss model for S400A1
2022-03-24 12:28:21,161 - stpipe.PathLossStep - WARNING - Skipping pathloss correction for this slit
2022-03-24 12:28:21,161 - stpipe.PathLossStep - WARNING - No correction provided for slit 2. Skipping
2022-03-24 12:28:21,161 - stpipe.PathLossStep - INFO - Working on slit S1600A1
2022-03-24 12:28:21,162 - stpipe.PathLossStep - INFO - Using aperture S1600A1
2022-03-24 12:28:21,190 - stpipe.PathLossStep - INFO - Working on slit S200B1
2022-03-24 12:28:21,190 - stpipe.PathLossStep - INFO - Using aperture S200B1
2022-03-24 12:28:21,225 - stpipe.PathLossStep - INFO - Step PathLossStep done
Running test for FS...
Checking if files exist and obtaining datamodels. This takes a few minutes...
from datamodel --> Detector: NRS2 Grating: G395H Filter: F290LP Lamp: LINE3 EXP_TYPE: NRS_FIXEDSLIT
Now looping through the slits. This may take a while...
Looping through the wavelengths...
Working with slitlet S200A1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
Pipeline pathloss correction in datamodel is empty. Skipping testing this slit.
Working with slitlet S200A2
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/pathloss_fs_ps.py:304: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/.astropy/cache/download/url/aa0c667e23a747249d9442a76121955c/contents' mode='rb' closefd=True> hdul = fits.open(reffile2use)
Calculating statistics...
Absolute Difference : mean = -4.060e-16 median = -4.441e-16 stdev = 8.374e-17
Maximum AbsoluteDifference = -2.220e-16
Minimum AbsoluteDifference = -4.441e-16
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
Working with slitlet S400A1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Unable to retrieve extension.
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
Pipeline pathloss correction in datamodel is empty. Skipping testing this slit.
Working with slitlet S1600A1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
<Figure size 432x288 with 0 Axes>
Calculating statistics...
Absolute Difference : mean = -7.765e-17 median = -2.220e-16 stdev = 1.613e-16
Maximum AbsoluteDifference = 2.220e-16
Minimum AbsoluteDifference = -2.220e-16
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
Working with slitlet S200B1
Slitlet name in fits file previous to pathloss
and in pathloss output file are the same.
Retrieved point source extension
Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0001.fits
<Figure size 432x288 with 0 Axes>
Calculating statistics...
Absolute Difference : mean = -2.490e-16 median = -2.220e-16 stdev = 1.455e-16
Maximum AbsoluteDifference = 0.000e+00
Minimum AbsoluteDifference = -4.441e-16
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
*** Final pathloss test result reported as PASSED ***
('* Script FS_PS.py took ', '2.2517956336339315 minutes to finish.')
Did pathloss validation test passed? All slits PASSED path_loss test.
Testing files for detector: nrs1
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/ipykernel_1159331/2294938804.py:64: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/.astropy/cache/download/url/aa0c667e23a747249d9442a76121955c/contents' mode='rb' closefd=True> median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_fs_ps.pathtest(
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_prism_nrs1_uncal.fits
2022-03-24 12:30:37,093 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:30:37,095 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:30:37,096 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:30:37,097 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:30:37,098 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:30:37,099 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:30:37,100 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:30:37,101 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:30:37,103 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:30:37,104 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:30:37,105 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:30:37,106 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:30:37,107 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:30:37,108 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:30:37,109 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:30:37,111 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:30:37,112 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_prism_nrs1_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 12:30:37,601 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_prism_nrs1_uncal.fits',).
2022-03-24 12:30:37,611 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:30:37,788 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_prism_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:30:37,799 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits'.
2022-03-24 12:30:37,801 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2022-03-24 12:30:37,803 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits'.
2022-03-24 12:30:37,805 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits'.
2022-03-24 12:30:37,806 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:30:37,806 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits'.
2022-03-24 12:30:37,808 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits'.
2022-03-24 12:30:37,810 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:30:37,810 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:30:37,811 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits'.
2022-03-24 12:30:37,812 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits'.
2022-03-24 12:30:37,814 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:30:37,814 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:30:37,815 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:30:38,440 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:30:38,441 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:30:38,556 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:30:38,557 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:30:38,560 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:30:39,013 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:30:39,015 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:30:39,039 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits
2022-03-24 12:30:39,453 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:30:39,806 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:30:39,808 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:30:39,831 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits
2022-03-24 12:30:40,469 - stpipe.Detector1Pipeline.saturation - INFO - Detected 9869 saturated pixels
2022-03-24 12:30:40,501 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:30:40,531 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:30:40,867 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:30:40,869 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:30:40,870 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:30:40,872 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:30:41,200 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:30:41,202 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:30:41,226 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0113.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-03-24 12:30:42,241 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:30:42,554 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:30:42,555 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:30:42,578 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0022.fits
2022-03-24 12:30:45,037 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-03-24 12:31:04,523 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:31:05,145 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:31:05,147 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:31:05,173 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits
2022-03-24 12:31:06,606 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:31:07,091 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:31:07,093 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:31:07,184 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0086.fits
2022-03-24 12:31:23,671 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=4, nframes=1, groupgap=0
2022-03-24 12:31:23,672 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-03-24 12:31:24,309 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:31:24,805 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:31:24,807 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:31:24,849 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:31:24,901 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-03-24 12:31:25,106 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-03-24 12:31:25,487 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:31:25,524 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:31:27,312 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from five groups.
2022-03-24 12:31:27,313 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 6540 pixels with at least one CR from four groups.
2022-03-24 12:31:27,314 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 139 pixels with at least one CR from three groups.
2022-03-24 12:31:28,019 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 2.53054 sec
2022-03-24 12:31:28,023 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 3.173563
2022-03-24 12:31:28,030 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:31:28,515 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:31:28,517 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:31:28,625 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-03-24 12:31:28,626 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-03-24 12:31:28,780 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:31:28,781 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:31:42,710 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 4
2022-03-24 12:31:42,711 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:31:42,929 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:31:43,418 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:31:43,421 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:31:43,520 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:31:43,521 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:31:43,526 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:31:43,907 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:31:43,909 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:31:43,989 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:31:43,990 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:31:43,994 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:31:43,996 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:31:43,998 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:31:44,009 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 12:31:44,398 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
MSA shutter configuration file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/V0030006000104_msa.fits
2022-03-24 12:31:44,400 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-03-24 12:31:44,555 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-03-24 12:31:44,602 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-03-24 12:31:44,603 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-03-24 12:31:44,604 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-03-24 12:31:44,606 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:31:44,942 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: [3, 4]
2022-03-24 12:31:44,944 - stpipe.AssignWcsStep - INFO - Computing WCS for 2 open slitlets
2022-03-24 12:31:45,046 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-03-24 12:31:45,047 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-03-24 12:31:45,048 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-03-24 12:31:45,049 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:31:45,065 - stpipe.AssignWcsStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2022-03-24 12:31:45,259 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 1
2022-03-24 12:31:45,260 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 2
2022-03-24 12:31:45,260 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 3
2022-03-24 12:31:45,270 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 4
2022-03-24 12:31:45,280 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-03-24 12:31:45,467 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/V0030006000104_msa.fits'}
2022-03-24 12:31:45,710 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-03-24 12:31:45,725 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-03-24 12:31:45,738 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-03-24 12:31:46,332 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:31:46,335 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:31:46,357 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-03-24 12:31:46,359 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-03-24 12:31:46,621 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.0332140289247036 deg
2022-03-24 12:31:46,622 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3367482721805573 deg
2022-03-24 12:31:46,623 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -1.0907214098475986e-05 deg
2022-03-24 12:31:46,624 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:31:46,639 - stpipe.MSAFlagOpenStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2022-03-24 12:31:46,825 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-03-24 12:31:46,882 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-03-24 12:31:46,918 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-03-24 12:31:47,009 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-03-24 12:31:47,043 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2588.086193887466.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2332.7637849323596.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2734.225436305883.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2098.587600763162.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2088.836558573466.
warnings.warn(f"Invalid interval: upper bound {upper} "
2022-03-24 12:32:04,166 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-03-24 12:32:04,181 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2022-03-24 12:32:04,933 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:32:04,937 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2022-03-24 12:32:04,957 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_MSASPEC
2022-03-24 12:32:05,151 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 3
2022-03-24 12:32:05,152 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1027 1464
2022-03-24 12:32:05,152 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1972 1983
2022-03-24 12:32:05,363 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:32:05,374 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.216281195 -45.702862740 156.216151591 -45.702738206 156.216089149 -45.702770462 156.216218751 -45.702894998
2022-03-24 12:32:05,376 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.216281195 -45.702862740 156.216151591 -45.702738206 156.216089149 -45.702770462 156.216218751 -45.702894998
2022-03-24 12:32:05,568 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 4
2022-03-24 12:32:05,569 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1275 1699
2022-03-24 12:32:05,570 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 34 43
2022-03-24 12:32:05,806 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:32:05,818 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.168120618 -45.657220874 156.167995139 -45.657100409 156.167933468 -45.657132147 156.168058946 -45.657252613
2022-03-24 12:32:05,819 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.168120618 -45.657220874 156.167995139 -45.657100409 156.167933468 -45.657132147 156.168058946 -45.657252613
2022-03-24 12:32:05,950 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2022-03-24 12:32:05,981 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2022-03-24 12:32:06,436 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:32:06,438 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:32:06,446 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_MSASPEC
2022-03-24 12:32:06,448 - stpipe.SourceTypeStep - INFO - source_id=3, stellarity=100.0000, type=POINT
2022-03-24 12:32:06,449 - stpipe.SourceTypeStep - INFO - source_id=4, stellarity=100.0000, type=POINT
2022-03-24 12:32:06,451 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2022-03-24 12:32:06,465 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2022-03-24 12:32:06,903 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:32:06,905 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:32:06,930 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0004.asdf
2022-03-24 12:32:07,395 - stpipe.WavecorrStep - INFO - Detected a POINT source type in slit 3
2022-03-24 12:32:07,396 - stpipe.WavecorrStep - INFO - slit name 3
2022-03-24 12:32:07,477 - stpipe.WavecorrStep - INFO - Using wavelength zero-point correction for aperture MOS
2022-03-24 12:32:07,482 - stpipe.WavecorrStep - INFO - Detected a POINT source type in slit 4
2022-03-24 12:32:07,482 - stpipe.WavecorrStep - INFO - slit name 4
2022-03-24 12:32:07,554 - stpipe.WavecorrStep - INFO - Using wavelength zero-point correction for aperture MOS
2022-03-24 12:32:07,562 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2022-03-24 12:32:07,579 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2022-03-24 12:32:08,083 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:32:08,085 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-03-24 12:32:30,289 - stpipe.FlatFieldStep - INFO - Working on slit 3
2022-03-24 12:32:31,060 - stpipe.FlatFieldStep - INFO - Working on slit 4
2022-03-24 12:32:31,895 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
2022-03-24 12:32:31,912 - stpipe.PathLossStep - INFO - PathLossStep instance created.
2022-03-24 12:32:32,416 - stpipe.PathLossStep - INFO - Step PathLossStep running with args (<MultiSlitModel from mos_prism_nrs1_uncal.fits>,).
2022-03-24 12:32:32,418 - stpipe.PathLossStep - INFO - Step PathLossStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-03-24 12:32:32,443 - stpipe.PathLossStep - INFO - Using PATHLOSS reference file /grp/crds/cache/references/jwst/jwst_nirspec_pathloss_0002.fits
2022-03-24 12:32:32,521 - stpipe.PathLossStep - INFO - Input exposure type is NRS_MSASPEC
2022-03-24 12:32:32,974 - stpipe.PathLossStep - INFO - Working on slit 0
2022-03-24 12:32:32,996 - stpipe.PathLossStep - INFO - Working on slit 1
2022-03-24 12:32:33,023 - stpipe.PathLossStep - INFO - Step PathLossStep done
Running test for MOS... Checking if files exist and obtaining datamodels. This takes a few minutes... from datamodel --> Detector: NRS1 Grating: PRISM Filter: CLEAR Lamp: LINE4 EXP_TYPE: NRS_MSASPEC Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0002.fits Looping through the slits... Retrieving reference file extensions Working with slitlet 3 Slitlet name in input file and in pathloss output file are the same. Retrieved point source extension slit_x, slit_y (-0.5, -0.5) Running test for POINT source...
Calculating statistics...
Absolute Difference : mean = -1.839e-02 median = -1.487e-02 stdev = 6.857e-03
Maximum AbsoluteDifference = -1.246e-02
Minimum AbsoluteDifference = -3.607e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 100%
-> 3xtheshold = 100%
-> 5xtheshold = 100%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
* TEST result: corrections residuals median = -0.018394595971838894 threshold difference = 9.999e-05
*** Result of the test: FAILED
Working with slitlet 4
Slitlet name in input file and in pathloss output file are the same.
Retrieved point source extension
slit_x, slit_y (-0.5, -0.5)
Running test for POINT source...
Calculating statistics...
Absolute Difference : mean = -1.836e-02 median = -1.483e-02 stdev = 6.885e-03
Maximum AbsoluteDifference = -1.246e-02
Minimum AbsoluteDifference = -3.603e-02
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 100%
-> 3xtheshold = 100%
-> 5xtheshold = 100%
*** WARNING: More than 10% of pixels have a median value greater than 3xthreshold!
*** WARNING: More than 10% of pixels have a median value greater than 5xthreshold!
* TEST result: corrections residuals median = -0.0183649834926872 threshold difference = 9.999e-05
*** Result of the test: FAILED
*** Final result for path_loss test will be reported as FAILED ***
('* Script pathloss_mos.py took ', '2.9957640171051025 seconds to finish.')
Did pathloss validation test passed? One or more slits FAILED path_loss test.
Testing files for detector: nrs2
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/ipykernel_1159331/2294938804.py:84: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/.astropy/cache/download/url/8e6d6917d5834a76434dc30e12182a4d/contents' mode='rb' closefd=True> median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_mos.pathtest(
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_prism_nrs2_uncal.fits
2022-03-24 12:32:36,880 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:32:36,882 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:32:36,883 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:32:36,884 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:32:36,886 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:32:36,887 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:32:36,888 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:32:36,889 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:32:36,890 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:32:36,891 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:32:36,893 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:32:36,894 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:32:36,895 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:32:36,896 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:32:36,897 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:32:36,898 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:32:36,904 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_prism_nrs2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 12:32:37,297 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_prism_nrs2_uncal.fits',).
2022-03-24 12:32:37,307 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:32:37,488 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_prism_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:32:37,498 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits'.
2022-03-24 12:32:37,499 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2022-03-24 12:32:37,501 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits'.
2022-03-24 12:32:37,502 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits'.
2022-03-24 12:32:37,504 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:32:37,504 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits'.
2022-03-24 12:32:37,506 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits'.
2022-03-24 12:32:37,508 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:32:37,508 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:32:37,508 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits'.
2022-03-24 12:32:37,510 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits'.
2022-03-24 12:32:37,512 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:32:37,512 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:32:37,513 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:32:38,108 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:32:38,110 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:32:38,233 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:32:38,234 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:32:38,238 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:32:38,587 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:32:38,588 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:32:38,613 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits
2022-03-24 12:32:38,965 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:32:39,342 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:32:39,344 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:32:39,368 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits
2022-03-24 12:32:39,942 - stpipe.Detector1Pipeline.saturation - INFO - Detected 5379 saturated pixels
2022-03-24 12:32:39,977 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:32:40,005 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:32:40,377 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:32:40,379 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:32:40,380 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:32:40,382 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:32:40,727 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:32:40,728 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:32:40,755 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0114.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-03-24 12:32:41,139 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:32:41,495 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:32:41,497 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:32:41,520 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0020.fits
2022-03-24 12:32:42,035 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-03-24 12:33:02,172 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:33:02,656 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:33:02,659 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:33:02,691 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits
2022-03-24 12:33:03,496 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:33:03,844 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:33:03,846 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:33:03,939 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0087.fits
2022-03-24 12:33:07,062 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=4, nframes=1, groupgap=0
2022-03-24 12:33:07,063 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-03-24 12:33:07,554 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:33:07,795 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:33:07,797 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:33:07,829 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:33:07,864 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-03-24 12:33:07,954 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-03-24 12:33:08,177 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:33:08,206 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:33:09,649 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from five groups.
2022-03-24 12:33:09,650 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 3051 pixels with at least one CR from four groups.
2022-03-24 12:33:09,650 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 3 pixels with at least one CR from three groups.
2022-03-24 12:33:09,984 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 1.80675 sec
2022-03-24 12:33:09,987 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 2.158039
2022-03-24 12:33:09,993 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:33:10,198 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 4, 3200, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:33:10,200 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:33:10,277 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-03-24 12:33:10,278 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-03-24 12:33:10,387 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:33:10,387 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:33:21,307 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 4
2022-03-24 12:33:21,308 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:33:21,497 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:33:21,726 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:33:21,728 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:33:21,794 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:33:21,794 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:33:21,799 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:33:21,960 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:33:21,961 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:33:22,031 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:33:22,032 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:33:22,036 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:33:22,038 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:33:22,040 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:33:22,049 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 12:33:22,216 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_prism_nrs2_uncal.fits>,).
2022-03-24 12:33:22,218 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
MSA shutter configuration file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/V0030006000104_msa.fits
2022-03-24 12:33:22,356 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1 2022-03-24 12:33:22,397 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.0332140289247036 deg 2022-03-24 12:33:22,397 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3367482721805573 deg 2022-03-24 12:33:22,398 - stpipe.AssignWcsStep - INFO - theta_y correction: -1.0907214098475986e-05 deg 2022-03-24 12:33:22,399 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg 2022-03-24 12:33:22,606 - stpipe.AssignWcsStep - INFO - Removing slit 3 from the list of open slits because the WCS bounding_box is completely outside the detector. 2022-03-24 12:33:22,643 - stpipe.AssignWcsStep - INFO - Removing slit 4 from the list of open slits because the WCS bounding_box is completely outside the detector. 2022-03-24 12:33:22,643 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: [] 2022-03-24 12:33:22,644 - stpipe.AssignWcsStep - CRITICAL - No open slits fall on detector NRS2.
An error occurred that made the pipeline crash, probably: No open slits fall on detector nrs2 Skipping test for this file. Did pathloss validation test passed? skipped Testing files for detector: nrs1 Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_g140m_line1_NRS1_uncal.fits
2022-03-24 12:33:23,424 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:33:23,426 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:33:23,426 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:33:23,427 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:33:23,428 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:33:23,429 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:33:23,430 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:33:23,431 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:33:23,432 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:33:23,433 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:33:23,434 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:33:23,435 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:33:23,436 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:33:23,437 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:33:23,438 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:33:23,439 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:33:23,441 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_g140m_line1_NRS1_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 12:33:23,616 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_g140m_line1_NRS1_uncal.fits',).
2022-03-24 12:33:23,625 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:33:23,791 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_g140m_line1_NRS1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:33:23,800 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits'.
2022-03-24 12:33:23,802 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2022-03-24 12:33:23,803 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0019.fits'.
2022-03-24 12:33:23,804 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits'.
2022-03-24 12:33:23,806 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:33:23,806 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits'.
2022-03-24 12:33:23,807 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2022-03-24 12:33:23,807 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:33:23,808 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:33:23,808 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0023.fits'.
2022-03-24 12:33:23,810 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits'.
2022-03-24 12:33:23,811 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:33:23,811 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:33:23,812 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:33:24,177 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:33:24,178 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:33:24,277 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:33:24,277 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:33:24,280 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:33:24,442 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:33:24,444 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:33:24,464 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits
2022-03-24 12:33:25,214 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:33:25,381 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:33:25,382 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:33:25,402 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0023.fits
2022-03-24 12:33:26,841 - stpipe.Detector1Pipeline.saturation - INFO - Detected 58922 saturated pixels
2022-03-24 12:33:26,866 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:33:26,878 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:33:27,056 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:33:27,058 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:33:27,058 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:33:27,060 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:33:27,354 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:33:27,355 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:33:27,381 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits
2022-03-24 12:33:29,264 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:33:29,597 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:33:29,599 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:33:29,612 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2022-03-24 12:33:29,613 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2022-03-24 12:33:29,613 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2022-03-24 12:33:29,613 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.0
2022-03-24 12:33:29,614 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = True
2022-03-24 12:33:33,113 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:33:33,454 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:33:33,456 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:33:33,482 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0019.fits
2022-03-24 12:33:38,206 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:33:38,529 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:33:38,531 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:33:38,556 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits
2022-03-24 12:33:42,012 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=6, nframes=1, groupgap=0
2022-03-24 12:33:42,013 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2022-03-24 12:33:42,313 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:33:42,635 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:33:42,637 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:33:42,649 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:33:42,663 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-03-24 12:33:42,742 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2022-03-24 12:33:43,711 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:33:43,759 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:33:46,480 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 50238 pixels with at least one CR from five groups.
2022-03-24 12:33:46,481 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 3305 pixels with at least one CR from four groups.
2022-03-24 12:33:46,481 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 3752 pixels with at least one CR from three groups.
2022-03-24 12:33:57,105 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 13.3926 sec
2022-03-24 12:33:57,110 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 14.461234
2022-03-24 12:33:57,117 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:33:57,450 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:33:57,452 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:33:57,491 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2022-03-24 12:33:57,491 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-03-24 12:33:57,643 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:33:57,644 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:34:20,235 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 6
2022-03-24 12:34:20,235 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:34:20,388 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:34:20,578 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:34:20,579 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:34:20,653 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:34:20,653 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:34:20,657 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:34:20,832 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:34:20,833 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:34:20,903 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:34:20,904 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:34:20,908 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:34:20,909 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:34:20,912 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:34:20,921 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 12:34:21,093 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:34:21,095 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
MSA shutter configuration file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/V8460001000101_msa.fits
2022-03-24 12:34:21,258 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-03-24 12:34:21,478 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-03-24 12:34:21,479 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-03-24 12:34:21,479 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-03-24 12:34:21,481 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:34:21,702 - stpipe.AssignWcsStep - INFO - Removing slit 6 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,714 - stpipe.AssignWcsStep - INFO - Removing slit 7 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,726 - stpipe.AssignWcsStep - INFO - Removing slit 8 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,740 - stpipe.AssignWcsStep - INFO - Removing slit 9 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,752 - stpipe.AssignWcsStep - INFO - Removing slit 10 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,764 - stpipe.AssignWcsStep - INFO - Removing slit 11 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,776 - stpipe.AssignWcsStep - INFO - Removing slit 14 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,788 - stpipe.AssignWcsStep - INFO - Removing slit 15 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,800 - stpipe.AssignWcsStep - INFO - Removing slit 16 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,812 - stpipe.AssignWcsStep - INFO - Removing slit 17 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,825 - stpipe.AssignWcsStep - INFO - Removing slit 18 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,837 - stpipe.AssignWcsStep - INFO - Removing slit 19 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,849 - stpipe.AssignWcsStep - INFO - Removing slit 21 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,861 - stpipe.AssignWcsStep - INFO - Removing slit 25 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,874 - stpipe.AssignWcsStep - INFO - Removing slit 26 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,887 - stpipe.AssignWcsStep - INFO - Removing slit 27 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,899 - stpipe.AssignWcsStep - INFO - Removing slit 29 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,911 - stpipe.AssignWcsStep - INFO - Removing slit 31 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,924 - stpipe.AssignWcsStep - INFO - Removing slit 32 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,937 - stpipe.AssignWcsStep - INFO - Removing slit 33 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,949 - stpipe.AssignWcsStep - INFO - Removing slit 35 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,961 - stpipe.AssignWcsStep - INFO - Removing slit 37 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,973 - stpipe.AssignWcsStep - INFO - Removing slit 38 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,985 - stpipe.AssignWcsStep - INFO - Removing slit 39 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:21,997 - stpipe.AssignWcsStep - INFO - Removing slit 41 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,034 - stpipe.AssignWcsStep - INFO - Removing slit 1 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,046 - stpipe.AssignWcsStep - INFO - Removing slit 2 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,058 - stpipe.AssignWcsStep - INFO - Removing slit 3 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,070 - stpipe.AssignWcsStep - INFO - Removing slit 4 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,083 - stpipe.AssignWcsStep - INFO - Removing slit 5 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,095 - stpipe.AssignWcsStep - INFO - Removing slit 12 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,107 - stpipe.AssignWcsStep - INFO - Removing slit 13 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,119 - stpipe.AssignWcsStep - INFO - Removing slit 20 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,132 - stpipe.AssignWcsStep - INFO - Removing slit 22 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,144 - stpipe.AssignWcsStep - INFO - Removing slit 23 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,156 - stpipe.AssignWcsStep - INFO - Removing slit 24 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,169 - stpipe.AssignWcsStep - INFO - Removing slit 28 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,181 - stpipe.AssignWcsStep - INFO - Removing slit 30 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,193 - stpipe.AssignWcsStep - INFO - Removing slit 34 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,206 - stpipe.AssignWcsStep - INFO - Removing slit 36 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,218 - stpipe.AssignWcsStep - INFO - Removing slit 40 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:34:22,510 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS1: [42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57, 58, 59, 60, 61, 62, 63, 64, 65, 66, 67, 68]
2022-03-24 12:34:22,511 - stpipe.AssignWcsStep - INFO - Computing WCS for 27 open slitlets
2022-03-24 12:34:22,548 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-03-24 12:34:22,549 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-03-24 12:34:22,549 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-03-24 12:34:22,550 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:34:22,564 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2022-03-24 12:34:22,713 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 1
2022-03-24 12:34:22,729 - stpipe.AssignWcsStep - INFO - There are 11 open slits in quadrant 2
2022-03-24 12:34:22,816 - stpipe.AssignWcsStep - INFO - There are 4 open slits in quadrant 3
2022-03-24 12:34:22,847 - stpipe.AssignWcsStep - INFO - There are 10 open slits in quadrant 4
2022-03-24 12:34:22,924 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-03-24 12:34:23,303 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0032.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0023.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/V8460001000101_msa.fits'}
2022-03-24 12:34:24,048 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-03-24 12:34:24,061 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-03-24 12:34:24,070 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-03-24 12:34:24,282 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:34:24,284 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:34:24,300 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-03-24 12:34:24,301 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-03-24 12:34:24,424 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-03-24 12:34:24,425 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-03-24 12:34:24,425 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-03-24 12:34:24,427 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:34:24,440 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2022-03-24 12:34:24,593 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-03-24 12:34:24,632 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-03-24 12:34:24,656 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-03-24 12:34:24,726 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-03-24 12:34:24,749 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2324.820049828629.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2244.599990785436.
warnings.warn(f"Invalid interval: upper bound {upper} "
2022-03-24 12:34:37,377 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-03-24 12:34:37,387 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2022-03-24 12:34:37,734 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:34:37,737 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2022-03-24 12:34:37,753 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_MSASPEC
2022-03-24 12:34:38,229 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 53
2022-03-24 12:34:38,230 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1542 2048
2022-03-24 12:34:38,231 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1316 1326
2022-03-24 12:34:38,425 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:38,434 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.226123221 -45.673642180 156.225994086 -45.673519691 156.225931834 -45.673551545 156.226060967 -45.673674035
2022-03-24 12:34:38,435 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.226123221 -45.673642180 156.225994086 -45.673519691 156.225931834 -45.673551545 156.226060967 -45.673674035
2022-03-24 12:34:39,149 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 54
2022-03-24 12:34:39,149 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1542 2048
2022-03-24 12:34:39,150 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1306 1316
2022-03-24 12:34:39,343 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:39,353 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.225872406 -45.673404272 156.225743296 -45.673281804 156.225681049 -45.673313656 156.225810156 -45.673436124
2022-03-24 12:34:39,354 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.225872406 -45.673404272 156.225743296 -45.673281804 156.225681049 -45.673313656 156.225810156 -45.673436124
2022-03-24 12:34:40,065 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 42
2022-03-24 12:34:40,066 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 2018 2048
2022-03-24 12:34:40,066 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 546 555
2022-03-24 12:34:40,255 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:40,264 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.223646010 -45.647128995 156.223518121 -45.647008321 156.223456024 -45.647039957 156.223583911 -45.647160632
2022-03-24 12:34:40,265 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.223646010 -45.647128995 156.223518121 -45.647008321 156.223456024 -45.647039957 156.223583911 -45.647160632
2022-03-24 12:34:40,710 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 43
2022-03-24 12:34:40,711 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1970 2048
2022-03-24 12:34:40,711 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 415 424
2022-03-24 12:34:40,902 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:40,911 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218966486 -45.644829601 156.218838959 -45.644709141 156.218776943 -45.644740759 156.218904467 -45.644861220
2022-03-24 12:34:40,912 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218966486 -45.644829601 156.218838959 -45.644709141 156.218776943 -45.644740759 156.218904467 -45.644861220
2022-03-24 12:34:41,644 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 44
2022-03-24 12:34:41,645 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1969 2048
2022-03-24 12:34:41,645 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 405 414
2022-03-24 12:34:41,833 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:41,841 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218718991 -45.644595818 156.218591488 -45.644475376 156.218529475 -45.644506992 156.218656977 -45.644627436
2022-03-24 12:34:41,842 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218718991 -45.644595818 156.218591488 -45.644475376 156.218529475 -45.644506992 156.218656977 -45.644627436
2022-03-24 12:34:42,571 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 45
2022-03-24 12:34:42,571 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1908 2048
2022-03-24 12:34:42,572 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 531 541
2022-03-24 12:34:42,761 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:42,770 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.219673020 -45.648613077 156.219545303 -45.648492383 156.219483265 -45.648524021 156.219610979 -45.648644716
2022-03-24 12:34:42,771 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.219673020 -45.648613077 156.219545303 -45.648492383 156.219483265 -45.648524021 156.219610979 -45.648644716
2022-03-24 12:34:43,220 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 46
2022-03-24 12:34:43,221 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1882 2048
2022-03-24 12:34:43,221 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 203 213
2022-03-24 12:34:43,409 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:43,418 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.211127421 -45.641279813 156.211000463 -45.641159678 156.210938572 -45.641191268 156.211065527 -45.641311404
2022-03-24 12:34:43,419 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.211127421 -45.641279813 156.211000463 -45.641159678 156.210938572 -45.641191268 156.211065527 -45.641311404
2022-03-24 12:34:44,190 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 47
2022-03-24 12:34:44,191 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1815 2048
2022-03-24 12:34:44,191 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 567 576
2022-03-24 12:34:44,380 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:44,389 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.217456055 -45.651006881 156.217328370 -45.650886079 156.217266356 -45.650917729 156.217394038 -45.651038531
2022-03-24 12:34:44,391 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.217456055 -45.651006881 156.217328370 -45.650886079 156.217266356 -45.650917729 156.217394038 -45.651038531
2022-03-24 12:34:45,156 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 48
2022-03-24 12:34:45,157 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1815 2048
2022-03-24 12:34:45,157 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 562 571
2022-03-24 12:34:45,346 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:45,355 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.217332149 -45.650889654 156.217204477 -45.650768862 156.217142464 -45.650800511 156.217270135 -45.650921304
2022-03-24 12:34:45,356 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.217332149 -45.650889654 156.217204477 -45.650768862 156.217142464 -45.650800511 156.217270135 -45.650921304
2022-03-24 12:34:45,812 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 49
2022-03-24 12:34:45,813 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1791 2048
2022-03-24 12:34:45,813 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 632 642
2022-03-24 12:34:46,004 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:46,014 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218210913 -45.652969013 156.218083107 -45.652848076 156.218021073 -45.652879740 156.218148877 -45.653000678
2022-03-24 12:34:46,015 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218210913 -45.652969013 156.218083107 -45.652848076 156.218021073 -45.652879740 156.218148877 -45.653000678
2022-03-24 12:34:46,806 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 50
2022-03-24 12:34:46,807 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1774 2048
2022-03-24 12:34:46,807 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 239 249
2022-03-24 12:34:46,998 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:47,008 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.208399869 -45.643929179 156.208272959 -45.643808942 156.208211096 -45.643840541 156.208338005 -45.643960778
2022-03-24 12:34:47,009 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.208399869 -45.643929179 156.208272959 -45.643808942 156.208211096 -45.643840541 156.208338005 -45.643960778
2022-03-24 12:34:47,466 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 51
2022-03-24 12:34:47,466 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1759 2048
2022-03-24 12:34:47,466 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 431 441
2022-03-24 12:34:47,989 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:47,997 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.212403238 -45.648718689 156.212275928 -45.648598111 156.212213993 -45.648629742 156.212341301 -45.648750320
2022-03-24 12:34:47,999 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.212403238 -45.648718689 156.212275928 -45.648598111 156.212213993 -45.648629742 156.212341301 -45.648750320
2022-03-24 12:34:48,454 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 52
2022-03-24 12:34:48,455 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1722 2048
2022-03-24 12:34:48,455 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 804 814
2022-03-24 12:34:48,644 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:48,653 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.219947139 -45.658234585 156.219819020 -45.658113276 156.219756938 -45.658144979 156.219885055 -45.658266289
2022-03-24 12:34:48,654 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.219947139 -45.658234585 156.219819020 -45.658113276 156.219756938 -45.658144979 156.219885055 -45.658266289
2022-03-24 12:34:49,442 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 55
2022-03-24 12:34:49,443 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 1022 2048
2022-03-24 12:34:49,443 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1416 1430
2022-03-24 12:34:49,638 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:49,647 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.211226719 -45.684941334 156.211098073 -45.684818233 156.211035880 -45.684850241 156.211164524 -45.684973343
2022-03-24 12:34:49,648 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.211226719 -45.684941334 156.211098073 -45.684818233 156.211035880 -45.684850241 156.211164524 -45.684973343
2022-03-24 12:34:50,107 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 65
2022-03-24 12:34:50,108 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 427 1893
2022-03-24 12:34:50,108 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1252 1273
2022-03-24 12:34:50,315 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:50,323 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.187669449 -45.691221095 156.187541886 -45.691097893 156.187479754 -45.691130071 156.187607315 -45.691253274
2022-03-24 12:34:50,324 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.187669449 -45.691221095 156.187541886 -45.691097893 156.187479754 -45.691130071 156.187607315 -45.691253274
2022-03-24 12:34:51,147 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 66
2022-03-24 12:34:51,148 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 426 1892
2022-03-24 12:34:51,149 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1453 1474
2022-03-24 12:34:51,357 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:51,365 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.192290190 -45.696194513 156.192162195 -45.696070854 156.192099979 -45.696103094 156.192227972 -45.696226755
2022-03-24 12:34:51,367 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.192290190 -45.696194513 156.192162195 -45.696070854 156.192099979 -45.696103094 156.192227972 -45.696226755
2022-03-24 12:34:51,884 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 68
2022-03-24 12:34:51,885 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 375 1842
2022-03-24 12:34:51,885 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1477 1500
2022-03-24 12:34:52,089 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:52,098 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191192483 -45.697686513 156.191064493 -45.697562756 156.191002259 -45.697595026 156.191130247 -45.697718784
2022-03-24 12:34:52,099 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191192483 -45.697686513 156.191064493 -45.697562756 156.191002259 -45.697595026 156.191130247 -45.697718784
2022-03-24 12:34:52,918 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 56
2022-03-24 12:34:52,919 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 872 2048
2022-03-24 12:34:52,919 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 769 783
2022-03-24 12:34:53,113 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:53,122 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191122501 -45.671742959 156.190995485 -45.671621176 156.190933579 -45.671653049 156.191060593 -45.671774833
2022-03-24 12:34:53,123 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191122501 -45.671742959 156.190995485 -45.671621176 156.190933579 -45.671653049 156.191060593 -45.671774833
2022-03-24 12:34:53,572 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 57
2022-03-24 12:34:53,572 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 805 2048
2022-03-24 12:34:53,573 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 355 370
2022-03-24 12:34:53,765 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:53,773 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.179343124 -45.662963603 156.179216994 -45.662842617 156.179155236 -45.662874401 156.179281365 -45.662995389
2022-03-24 12:34:53,775 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.179343124 -45.662963603 156.179216994 -45.662842617 156.179155236 -45.662874401 156.179281365 -45.662995389
2022-03-24 12:34:54,603 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 58
2022-03-24 12:34:54,604 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 731 2048
2022-03-24 12:34:54,604 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 259 275
2022-03-24 12:34:54,798 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:54,807 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.174716949 -45.661919476 156.174591057 -45.661798624 156.174529324 -45.661830406 156.174655215 -45.661951259
2022-03-24 12:34:54,808 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.174716949 -45.661919476 156.174591057 -45.661798624 156.174529324 -45.661830406 156.174655215 -45.661951259
2022-03-24 12:34:55,263 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 59
2022-03-24 12:34:55,264 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 658 2048
2022-03-24 12:34:55,264 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 72 88
2022-03-24 12:34:55,458 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:55,466 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.167987333 -45.658726530 156.167861814 -45.658605973 156.167800128 -45.658637729 156.167925645 -45.658758288
2022-03-24 12:34:55,467 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.167987333 -45.658726530 156.167861814 -45.658605973 156.167800128 -45.658637729 156.167925645 -45.658758288
2022-03-24 12:34:56,313 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 60
2022-03-24 12:34:56,313 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 641 2048
2022-03-24 12:34:56,314 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 682 699
2022-03-24 12:34:56,509 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:56,517 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.181507045 -45.673611447 156.181380443 -45.673489678 156.181318559 -45.673521602 156.181445158 -45.673643373
2022-03-24 12:34:56,519 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.181507045 -45.673611447 156.181380443 -45.673489678 156.181318559 -45.673521602 156.181445158 -45.673643373
2022-03-24 12:34:56,963 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 61
2022-03-24 12:34:56,964 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 620 2048
2022-03-24 12:34:56,964 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 823 840
2022-03-24 12:34:57,158 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:57,167 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.184095390 -45.677365774 156.183968526 -45.677243686 156.183906587 -45.677275659 156.184033450 -45.677397747
2022-03-24 12:34:57,168 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.184095390 -45.677365774 156.183968526 -45.677243686 156.183906587 -45.677275659 156.184033450 -45.677397747
2022-03-24 12:34:58,040 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 62
2022-03-24 12:34:58,041 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 570 2032
2022-03-24 12:34:58,041 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 510 528
2022-03-24 12:34:58,242 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:58,252 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.175200333 -45.670700849 156.175074128 -45.670579384 156.175012293 -45.670611285 156.175138497 -45.670732752
2022-03-24 12:34:58,253 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.175200333 -45.670700849 156.175074128 -45.670579384 156.175012293 -45.670611285 156.175138497 -45.670732752
2022-03-24 12:34:58,706 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 63
2022-03-24 12:34:58,707 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 454 1915
2022-03-24 12:34:58,707 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 182 200
2022-03-24 12:34:58,905 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:58,913 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.163846800 -45.664818400 156.163721256 -45.664697497 156.163659498 -45.664729348 156.163785040 -45.664850252
2022-03-24 12:34:58,915 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.163846800 -45.664818400 156.163721256 -45.664697497 156.163659498 -45.664729348 156.163785040 -45.664850252
2022-03-24 12:34:59,782 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 64
2022-03-24 12:34:59,782 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 454 1915
2022-03-24 12:34:59,783 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 177 195
2022-03-24 12:34:59,980 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:34:59,989 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.163724974 -45.664701077 156.163599439 -45.664580184 156.163537682 -45.664612033 156.163663216 -45.664732928
2022-03-24 12:34:59,990 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.163724974 -45.664701077 156.163599439 -45.664580184 156.163537682 -45.664612033 156.163663216 -45.664732928
2022-03-24 12:35:00,452 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 67
2022-03-24 12:35:00,453 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 328 1789
2022-03-24 12:35:00,453 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 131 150
2022-03-24 12:35:00,656 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:35:00,665 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.158533940 -45.665758025 156.158408563 -45.665637125 156.158346784 -45.665669007 156.158472159 -45.665789909
2022-03-24 12:35:00,666 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.158533940 -45.665758025 156.158408563 -45.665637125 156.158346784 -45.665669007 156.158472159 -45.665789909
2022-03-24 12:35:02,537 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2022-03-24 12:35:04,693 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2022-03-24 12:35:05,117 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:35:05,119 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:35:05,126 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_MSASPEC
2022-03-24 12:35:05,128 - stpipe.SourceTypeStep - INFO - source_id=53, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,129 - stpipe.SourceTypeStep - INFO - source_id=54, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,130 - stpipe.SourceTypeStep - INFO - source_id=42, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,131 - stpipe.SourceTypeStep - INFO - source_id=43, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,132 - stpipe.SourceTypeStep - INFO - source_id=44, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,133 - stpipe.SourceTypeStep - INFO - source_id=45, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,134 - stpipe.SourceTypeStep - INFO - source_id=46, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,135 - stpipe.SourceTypeStep - INFO - source_id=47, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,136 - stpipe.SourceTypeStep - INFO - source_id=48, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,137 - stpipe.SourceTypeStep - INFO - source_id=49, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,138 - stpipe.SourceTypeStep - INFO - source_id=50, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,139 - stpipe.SourceTypeStep - INFO - source_id=51, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,140 - stpipe.SourceTypeStep - INFO - source_id=52, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,141 - stpipe.SourceTypeStep - INFO - source_id=55, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,142 - stpipe.SourceTypeStep - INFO - source_id=65, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,143 - stpipe.SourceTypeStep - INFO - source_id=66, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,144 - stpipe.SourceTypeStep - INFO - source_id=68, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,145 - stpipe.SourceTypeStep - INFO - source_id=56, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,146 - stpipe.SourceTypeStep - INFO - source_id=57, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,147 - stpipe.SourceTypeStep - INFO - source_id=58, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,148 - stpipe.SourceTypeStep - INFO - source_id=59, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,149 - stpipe.SourceTypeStep - INFO - source_id=60, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,150 - stpipe.SourceTypeStep - INFO - source_id=61, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,151 - stpipe.SourceTypeStep - INFO - source_id=62, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,152 - stpipe.SourceTypeStep - INFO - source_id=63, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,153 - stpipe.SourceTypeStep - INFO - source_id=64, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,154 - stpipe.SourceTypeStep - INFO - source_id=67, stellarity=0.0000, type=EXTENDED
2022-03-24 12:35:05,156 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2022-03-24 12:35:05,219 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2022-03-24 12:35:05,570 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:35:05,572 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:35:05,631 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0004.asdf
2022-03-24 12:35:10,853 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 53
2022-03-24 12:35:10,853 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 54
2022-03-24 12:35:10,854 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 42
2022-03-24 12:35:10,854 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 43
2022-03-24 12:35:10,854 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 44
2022-03-24 12:35:10,855 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 45
2022-03-24 12:35:10,855 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 46
2022-03-24 12:35:10,855 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 47
2022-03-24 12:35:10,855 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 48
2022-03-24 12:35:10,856 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 49
2022-03-24 12:35:10,856 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 50
2022-03-24 12:35:10,856 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 51
2022-03-24 12:35:10,856 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 52
2022-03-24 12:35:10,857 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 55
2022-03-24 12:35:10,857 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 65
2022-03-24 12:35:10,857 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 66
2022-03-24 12:35:10,858 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 68
2022-03-24 12:35:10,858 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 56
2022-03-24 12:35:10,858 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 57
2022-03-24 12:35:10,858 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 58
2022-03-24 12:35:10,859 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 59
2022-03-24 12:35:10,859 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 60
2022-03-24 12:35:10,859 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 61
2022-03-24 12:35:10,859 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 62
2022-03-24 12:35:10,860 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 63
2022-03-24 12:35:10,860 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 64
2022-03-24 12:35:10,860 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 67
2022-03-24 12:35:10,864 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2022-03-24 12:35:10,916 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2022-03-24 12:35:11,526 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:35:11,528 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-03-24 12:35:35,019 - stpipe.FlatFieldStep - INFO - Working on slit 53
2022-03-24 12:35:35,931 - stpipe.FlatFieldStep - INFO - Working on slit 54
2022-03-24 12:35:36,841 - stpipe.FlatFieldStep - INFO - Working on slit 42
2022-03-24 12:35:37,045 - stpipe.FlatFieldStep - INFO - Working on slit 43
2022-03-24 12:35:37,306 - stpipe.FlatFieldStep - INFO - Working on slit 44
2022-03-24 12:35:37,570 - stpipe.FlatFieldStep - INFO - Working on slit 45
2022-03-24 12:35:37,915 - stpipe.FlatFieldStep - INFO - Working on slit 46
2022-03-24 12:35:38,332 - stpipe.FlatFieldStep - INFO - Working on slit 47
2022-03-24 12:35:38,803 - stpipe.FlatFieldStep - INFO - Working on slit 48
2022-03-24 12:35:40,181 - stpipe.FlatFieldStep - INFO - Working on slit 49
2022-03-24 12:35:40,698 - stpipe.FlatFieldStep - INFO - Working on slit 50
2022-03-24 12:35:41,239 - stpipe.FlatFieldStep - INFO - Working on slit 51
2022-03-24 12:35:41,765 - stpipe.FlatFieldStep - INFO - Working on slit 52
2022-03-24 12:35:42,333 - stpipe.FlatFieldStep - INFO - Working on slit 55
2022-03-24 12:35:43,860 - stpipe.FlatFieldStep - INFO - Working on slit 65
2022-03-24 12:35:46,019 - stpipe.FlatFieldStep - INFO - Working on slit 66
2022-03-24 12:35:48,178 - stpipe.FlatFieldStep - INFO - Working on slit 68
2022-03-24 12:35:50,221 - stpipe.FlatFieldStep - INFO - Working on slit 56
2022-03-24 12:35:51,957 - stpipe.FlatFieldStep - INFO - Working on slit 57
2022-03-24 12:35:53,864 - stpipe.FlatFieldStep - INFO - Working on slit 58
2022-03-24 12:35:55,820 - stpipe.FlatFieldStep - INFO - Working on slit 59
2022-03-24 12:35:57,875 - stpipe.FlatFieldStep - INFO - Working on slit 60
2022-03-24 12:35:59,936 - stpipe.FlatFieldStep - INFO - Working on slit 61
2022-03-24 12:36:02,012 - stpipe.FlatFieldStep - INFO - Working on slit 62
2022-03-24 12:36:04,119 - stpipe.FlatFieldStep - INFO - Working on slit 63
2022-03-24 12:36:06,244 - stpipe.FlatFieldStep - INFO - Working on slit 64
2022-03-24 12:36:08,370 - stpipe.FlatFieldStep - INFO - Working on slit 67
2022-03-24 12:36:12,506 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
2022-03-24 12:36:12,557 - stpipe.PathLossStep - INFO - PathLossStep instance created.
2022-03-24 12:36:13,097 - stpipe.PathLossStep - INFO - Step PathLossStep running with args (<MultiSlitModel from mos_g140m_line1_NRS1_uncal.fits>,).
2022-03-24 12:36:13,099 - stpipe.PathLossStep - INFO - Step PathLossStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-03-24 12:36:13,160 - stpipe.PathLossStep - INFO - Using PATHLOSS reference file /grp/crds/cache/references/jwst/jwst_nirspec_pathloss_0002.fits
2022-03-24 12:36:13,221 - stpipe.PathLossStep - INFO - Input exposure type is NRS_MSASPEC
2022-03-24 12:36:18,856 - stpipe.PathLossStep - INFO - Working on slit 0
2022-03-24 12:36:18,876 - stpipe.PathLossStep - INFO - Working on slit 1
2022-03-24 12:36:18,896 - stpipe.PathLossStep - INFO - Working on slit 2
2022-03-24 12:36:18,916 - stpipe.PathLossStep - INFO - Working on slit 3
2022-03-24 12:36:18,935 - stpipe.PathLossStep - INFO - Working on slit 4
2022-03-24 12:36:18,954 - stpipe.PathLossStep - INFO - Working on slit 5
2022-03-24 12:36:18,973 - stpipe.PathLossStep - INFO - Working on slit 6
2022-03-24 12:36:18,992 - stpipe.PathLossStep - INFO - Working on slit 7
2022-03-24 12:36:19,011 - stpipe.PathLossStep - INFO - Working on slit 8
2022-03-24 12:36:19,031 - stpipe.PathLossStep - INFO - Working on slit 9
2022-03-24 12:36:19,050 - stpipe.PathLossStep - INFO - Working on slit 10
2022-03-24 12:36:19,069 - stpipe.PathLossStep - INFO - Working on slit 11
2022-03-24 12:36:19,089 - stpipe.PathLossStep - INFO - Working on slit 12
2022-03-24 12:36:19,109 - stpipe.PathLossStep - INFO - Working on slit 13
2022-03-24 12:36:19,129 - stpipe.PathLossStep - INFO - Working on slit 14
2022-03-24 12:36:19,151 - stpipe.PathLossStep - INFO - Working on slit 15
2022-03-24 12:36:19,171 - stpipe.PathLossStep - INFO - Working on slit 16
2022-03-24 12:36:19,192 - stpipe.PathLossStep - INFO - Working on slit 17
2022-03-24 12:36:19,212 - stpipe.PathLossStep - INFO - Working on slit 18
2022-03-24 12:36:19,232 - stpipe.PathLossStep - INFO - Working on slit 19
2022-03-24 12:36:19,253 - stpipe.PathLossStep - INFO - Working on slit 20
2022-03-24 12:36:19,274 - stpipe.PathLossStep - INFO - Working on slit 21
2022-03-24 12:36:19,295 - stpipe.PathLossStep - INFO - Working on slit 22
2022-03-24 12:36:19,316 - stpipe.PathLossStep - INFO - Working on slit 23
2022-03-24 12:36:19,338 - stpipe.PathLossStep - INFO - Working on slit 24
2022-03-24 12:36:19,359 - stpipe.PathLossStep - INFO - Working on slit 25
2022-03-24 12:36:19,380 - stpipe.PathLossStep - INFO - Working on slit 26
2022-03-24 12:36:19,406 - stpipe.PathLossStep - INFO - Step PathLossStep done
Running test for MOS... Checking if files exist and obtaining datamodels. This takes a few minutes... from datamodel --> Detector: NRS1 Grating: G140M Filter: F100LP Lamp: LINE1 EXP_TYPE: NRS_MSASPEC Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0002.fits Looping through the slits... Retrieving reference file extensions Working with slitlet 53 Slitlet name in input file and in pathloss output file are the same. Retrieved extended/uniform source extension 3 slit_x, slit_y (-0.5, -0.5) Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 3.003e-08 median = 3.057e-08 stdev = 3.503e-08
Maximum AbsoluteDifference = 1.019e-07
Minimum AbsoluteDifference = -4.432e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 3.0027843072897874e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 54
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 3.022e-08 median = 2.975e-08 stdev = 3.520e-08
Maximum AbsoluteDifference = 1.023e-07
Minimum AbsoluteDifference = -4.223e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 3.022224755483523e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 42
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.004e-08 median = 1.866e-08 stdev = 3.421e-08
Maximum AbsoluteDifference = 8.544e-08
Minimum AbsoluteDifference = -4.042e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.004418435674893e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 43
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.079e-08 median = 2.087e-08 stdev = 3.468e-08
Maximum AbsoluteDifference = 8.930e-08
Minimum AbsoluteDifference = -4.479e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.078751090862669e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 44
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.225e-08 median = 2.276e-08 stdev = 3.474e-08
Maximum AbsoluteDifference = 8.536e-08
Minimum AbsoluteDifference = -4.266e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.2254868009763256e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 45
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.263e-08 median = 2.367e-08 stdev = 3.476e-08
Maximum AbsoluteDifference = 8.860e-08
Minimum AbsoluteDifference = -4.239e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.262627254664621e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 46
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.375e-08 median = 2.504e-08 stdev = 3.482e-08
Maximum AbsoluteDifference = 9.250e-08
Minimum AbsoluteDifference = -4.390e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.3751411544810292e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 47
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.355e-08 median = 2.426e-08 stdev = 3.501e-08
Maximum AbsoluteDifference = 9.262e-08
Minimum AbsoluteDifference = -4.653e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.354814946203582e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 48
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.400e-08 median = 2.439e-08 stdev = 3.485e-08
Maximum AbsoluteDifference = 9.412e-08
Minimum AbsoluteDifference = -4.241e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.3997835847636903e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 49
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.407e-08 median = 2.461e-08 stdev = 3.436e-08
Maximum AbsoluteDifference = 9.226e-08
Minimum AbsoluteDifference = -4.196e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.4070299159017425e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 50
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.585e-08 median = 2.600e-08 stdev = 3.473e-08
Maximum AbsoluteDifference = 9.135e-08
Minimum AbsoluteDifference = -4.207e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.58538753609662e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 51
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.495e-08 median = 2.511e-08 stdev = 3.403e-08
Maximum AbsoluteDifference = 9.116e-08
Minimum AbsoluteDifference = -4.373e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.4945332353714758e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 52
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.544e-08 median = 2.559e-08 stdev = 3.474e-08
Maximum AbsoluteDifference = 9.297e-08
Minimum AbsoluteDifference = -4.617e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.54357900534513e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 55
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.712e-08 median = 2.762e-08 stdev = 3.623e-08
Maximum AbsoluteDifference = 1.087e-07
Minimum AbsoluteDifference = -5.751e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.7116146646840717e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 65
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.939e-08 median = 1.968e-08 stdev = 3.775e-08
Maximum AbsoluteDifference = 1.067e-07
Minimum AbsoluteDifference = -7.853e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9387405375540964e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 66
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.024e-08 median = 1.979e-08 stdev = 3.771e-08
Maximum AbsoluteDifference = 1.069e-07
Minimum AbsoluteDifference = -7.853e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0242555184264575e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 68
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.951e-08 median = 1.979e-08 stdev = 3.787e-08
Maximum AbsoluteDifference = 1.075e-07
Minimum AbsoluteDifference = -7.889e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.95070386604461e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 56
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.420e-08 median = 2.387e-08 stdev = 3.680e-08
Maximum AbsoluteDifference = 1.077e-07
Minimum AbsoluteDifference = -5.817e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.4198977394282385e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 57
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.324e-08 median = 2.303e-08 stdev = 3.682e-08
Maximum AbsoluteDifference = 1.070e-07
Minimum AbsoluteDifference = -5.695e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.3243213958183843e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 58
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.256e-08 median = 2.231e-08 stdev = 3.672e-08
Maximum AbsoluteDifference = 1.090e-07
Minimum AbsoluteDifference = -6.032e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.2557602843599438e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 59
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.185e-08 median = 2.189e-08 stdev = 3.698e-08
Maximum AbsoluteDifference = 1.058e-07
Minimum AbsoluteDifference = -7.109e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.1852547624098308e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 60
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.095e-08 median = 2.088e-08 stdev = 3.711e-08
Maximum AbsoluteDifference = 1.085e-07
Minimum AbsoluteDifference = -7.374e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0947486120525435e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 61
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.128e-08 median = 2.183e-08 stdev = 3.713e-08
Maximum AbsoluteDifference = 1.075e-07
Minimum AbsoluteDifference = -7.391e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.128261719670769e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 62
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.015e-08 median = 2.029e-08 stdev = 3.774e-08
Maximum AbsoluteDifference = 1.065e-07
Minimum AbsoluteDifference = -8.276e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0149924684671406e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 63
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.923e-08 median = 1.906e-08 stdev = 3.763e-08
Maximum AbsoluteDifference = 1.050e-07
Minimum AbsoluteDifference = -8.286e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9230106882859107e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 64
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.027e-08 median = 2.033e-08 stdev = 3.759e-08
Maximum AbsoluteDifference = 1.083e-07
Minimum AbsoluteDifference = -7.730e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0274970161609987e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 67
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.021e-08 median = 2.037e-08 stdev = 3.740e-08
Maximum AbsoluteDifference = 1.065e-07
Minimum AbsoluteDifference = -8.303e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0207304581508286e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
*** Final result for path_loss test will be reported as PASSED ***
('* Script pathloss_mos.py took ', '25.712780475616455 seconds to finish.')
Did pathloss validation test passed? All slits PASSED path_loss test.
Testing files for detector: nrs2
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/ipykernel_1159331/2294938804.py:84: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/.astropy/cache/download/url/8e6d6917d5834a76434dc30e12182a4d/contents' mode='rb' closefd=True> median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_mos.pathtest(
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_g140m_line1_NRS2_uncal.fits
2022-03-24 12:36:45,880 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:36:45,881 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:36:45,882 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:36:45,883 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:36:45,884 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:36:45,885 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:36:45,886 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:36:45,887 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:36:45,888 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:36:45,889 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:36:45,890 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:36:45,891 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:36:45,892 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:36:45,893 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:36:45,894 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:36:45,895 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:36:45,897 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_g140m_line1_NRS2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 12:36:46,539 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/mos_g140m_line1_NRS2_uncal.fits',).
2022-03-24 12:36:46,548 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:36:46,710 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'mos_g140m_line1_NRS2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:36:46,718 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits'.
2022-03-24 12:36:46,719 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2022-03-24 12:36:46,720 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0020.fits'.
2022-03-24 12:36:46,721 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits'.
2022-03-24 12:36:46,723 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:36:46,723 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits'.
2022-03-24 12:36:46,724 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2022-03-24 12:36:46,725 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:36:46,725 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:36:46,725 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0022.fits'.
2022-03-24 12:36:46,726 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits'.
2022-03-24 12:36:46,727 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:36:46,728 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:36:46,728 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:36:47,519 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:36:47,521 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:36:47,613 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:36:47,614 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:36:47,616 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:36:48,213 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:36:48,215 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:36:48,236 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits
2022-03-24 12:36:48,974 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:36:49,572 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:36:49,573 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:36:49,594 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0022.fits
2022-03-24 12:36:50,741 - stpipe.Detector1Pipeline.saturation - INFO - Detected 83201 saturated pixels
2022-03-24 12:36:50,763 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:36:50,774 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:36:51,658 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:36:51,660 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:36:51,660 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:36:51,662 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:36:52,799 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:36:52,801 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:36:52,829 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits
2022-03-24 12:36:54,754 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:36:55,872 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:36:55,874 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:36:55,886 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2022-03-24 12:36:55,886 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2022-03-24 12:36:55,887 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2022-03-24 12:36:55,887 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.0
2022-03-24 12:36:55,887 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = True
2022-03-24 12:36:59,633 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:37:00,745 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:37:00,747 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:37:00,772 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0020.fits
2022-03-24 12:37:04,586 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:37:05,709 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:37:05,711 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:37:05,737 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits
2022-03-24 12:37:09,573 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=6, nframes=1, groupgap=0
2022-03-24 12:37:09,574 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2022-03-24 12:37:09,873 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:37:10,978 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:37:10,980 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:37:10,991 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:37:11,007 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-03-24 12:37:11,187 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2022-03-24 12:37:12,273 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:37:12,319 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:37:15,053 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 59841 pixels with at least one CR from five groups.
2022-03-24 12:37:15,054 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 3090 pixels with at least one CR from four groups.
2022-03-24 12:37:15,055 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 2855 pixels with at least one CR from three groups.
2022-03-24 12:37:28,547 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 16.2729 sec
2022-03-24 12:37:28,553 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 17.561241
2022-03-24 12:37:28,563 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:37:29,738 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 6, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:37:29,740 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:37:29,781 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2022-03-24 12:37:29,782 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-03-24 12:37:29,915 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:37:29,916 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:37:52,991 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 6
2022-03-24 12:37:52,992 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:37:53,144 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:37:53,833 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:37:53,834 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:37:53,909 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:37:53,909 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:37:53,913 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:37:54,514 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:37:54,516 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:37:54,585 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:37:54,585 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:37:54,590 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:37:54,591 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:37:54,593 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:37:54,602 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
MSA shutter configuration file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/V8460001000101_msa.fits
2022-03-24 12:37:55,215 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:37:55,216 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-03-24 12:37:55,374 - stpipe.AssignWcsStep - INFO - Retrieving open MSA slitlets for msa_metadata_id = 1 and dither_index = 1
2022-03-24 12:37:55,595 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-03-24 12:37:55,595 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-03-24 12:37:55,596 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-03-24 12:37:55,597 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:37:56,541 - stpipe.AssignWcsStep - INFO - Removing slit 65 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,554 - stpipe.AssignWcsStep - INFO - Removing slit 66 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,567 - stpipe.AssignWcsStep - INFO - Removing slit 68 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,605 - stpipe.AssignWcsStep - INFO - Removing slit 58 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,619 - stpipe.AssignWcsStep - INFO - Removing slit 59 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,632 - stpipe.AssignWcsStep - INFO - Removing slit 60 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,646 - stpipe.AssignWcsStep - INFO - Removing slit 61 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,659 - stpipe.AssignWcsStep - INFO - Removing slit 62 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,672 - stpipe.AssignWcsStep - INFO - Removing slit 63 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,686 - stpipe.AssignWcsStep - INFO - Removing slit 64 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,699 - stpipe.AssignWcsStep - INFO - Removing slit 67 from the list of open slits because the WCS bounding_box is completely outside the detector.
2022-03-24 12:37:56,700 - stpipe.AssignWcsStep - INFO - Slits projected on detector NRS2: [1, 2, 3, 4, 5, 6, 7, 8, 9, 10, 11, 12, 13, 14, 15, 16, 17, 18, 19, 20, 21, 22, 23, 24, 25, 26, 27, 28, 29, 30, 31, 32, 33, 34, 35, 36, 37, 38, 39, 40, 41, 42, 43, 44, 45, 46, 47, 48, 49, 50, 51, 52, 53, 54, 55, 56, 57]
2022-03-24 12:37:56,700 - stpipe.AssignWcsStep - INFO - Computing WCS for 57 open slitlets
2022-03-24 12:37:56,736 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-03-24 12:37:56,737 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-03-24 12:37:56,737 - stpipe.AssignWcsStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-03-24 12:37:56,739 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:37:56,752 - stpipe.AssignWcsStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2022-03-24 12:37:56,902 - stpipe.AssignWcsStep - INFO - There are 27 open slits in quadrant 1
2022-03-24 12:37:57,114 - stpipe.AssignWcsStep - INFO - There are 27 open slits in quadrant 2
2022-03-24 12:37:57,325 - stpipe.AssignWcsStep - INFO - There are 1 open slits in quadrant 3
2022-03-24 12:37:57,334 - stpipe.AssignWcsStep - INFO - There are 2 open slits in quadrant 4
2022-03-24 12:37:57,349 - stpipe.AssignWcsStep - INFO - There are 0 open slits in quadrant 5
2022-03-24 12:37:57,530 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_msaspec pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0032.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0023.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': None, 'ifufore': None, 'ifuslicer': None, 'msametafile': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/V8460001000101_msa.fits'}
2022-03-24 12:37:59,667 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-03-24 12:37:59,680 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-03-24 12:37:59,689 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-03-24 12:38:00,475 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:38:00,478 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:38:00,496 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-03-24 12:38:00,497 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-03-24 12:38:00,653 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1260581910610199 deg
2022-03-24 12:38:00,653 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3316612243652344 deg
2022-03-24 12:38:00,654 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: 0.0002496099796717191 deg
2022-03-24 12:38:00,655 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:38:00,668 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[9.7e-07, 1.89e-06]
2022-03-24 12:38:00,820 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-03-24 12:38:00,859 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-03-24 12:38:00,884 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-03-24 12:38:00,957 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-03-24 12:38:00,982 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound -103.67242647612011 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound -212.68515843943806 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound -342.07188051944695 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound -321.21045292546796 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound -342.531517365775 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound -420.84938370342115 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound -450.04257156132417 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound -459.05344370773037 is strictly less than lower bound -0.5.
warnings.warn(f"Invalid interval: upper bound {upper} "
2022-03-24 12:38:15,406 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-03-24 12:38:15,417 - stpipe.Extract2dStep - INFO - Extract2dStep instance created.
2022-03-24 12:38:16,239 - stpipe.Extract2dStep - INFO - Step Extract2dStep running with args (<ImageModel(2048, 2048) from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:38:16,242 - stpipe.Extract2dStep - INFO - Step Extract2dStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'slit_name': None, 'extract_orders': None, 'tsgrism_extract_height': None, 'wfss_extract_half_height': 5, 'grism_objects': None, 'mmag_extract': 99.0}
2022-03-24 12:38:16,260 - stpipe.Extract2dStep - INFO - EXP_TYPE is NRS_MSASPEC
2022-03-24 12:38:17,121 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 6
2022-03-24 12:38:17,122 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 138 1619
2022-03-24 12:38:17,123 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1762 1785
2022-03-24 12:38:17,330 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:17,339 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.263159350 -45.671304678 156.263027991 -45.671181725 156.262965146 -45.671213584 156.263096502 -45.671336538
2022-03-24 12:38:17,340 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.263159350 -45.671304678 156.263027991 -45.671181725 156.262965146 -45.671213584 156.263096502 -45.671336538
2022-03-24 12:38:18,866 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 7
2022-03-24 12:38:18,867 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 138 1619
2022-03-24 12:38:18,867 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1757 1780
2022-03-24 12:38:19,077 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:19,086 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.263031777 -45.671185268 156.262900430 -45.671062325 156.262837587 -45.671094183 156.262968931 -45.671217127
2022-03-24 12:38:19,087 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.263031777 -45.671185268 156.262900430 -45.671062325 156.262837587 -45.671094183 156.262968931 -45.671217127
2022-03-24 12:38:19,952 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 8
2022-03-24 12:38:19,952 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 137 1618
2022-03-24 12:38:19,953 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1807 1830
2022-03-24 12:38:20,165 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:20,174 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.264221225 -45.672423837 156.264089757 -45.672300789 156.264026890 -45.672332658 156.264158355 -45.672455707
2022-03-24 12:38:20,175 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.264221225 -45.672423837 156.264089757 -45.672300789 156.264026890 -45.672332658 156.264158355 -45.672455707
2022-03-24 12:38:21,829 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 9
2022-03-24 12:38:21,830 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 137 1618
2022-03-24 12:38:21,830 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1802 1825
2022-03-24 12:38:22,038 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:22,047 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.264093546 -45.672304335 156.263962090 -45.672181297 156.263899225 -45.672213165 156.264030678 -45.672336204
2022-03-24 12:38:22,048 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.264093546 -45.672304335 156.263962090 -45.672181297 156.263899225 -45.672213165 156.264030678 -45.672336204
2022-03-24 12:38:22,909 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 10
2022-03-24 12:38:22,910 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 137 1618
2022-03-24 12:38:22,910 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1797 1820
2022-03-24 12:38:23,118 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:23,126 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.263965879 -45.672184843 156.263834436 -45.672061816 156.263771574 -45.672093683 156.263903014 -45.672216711
2022-03-24 12:38:23,127 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.263965879 -45.672184843 156.263834436 -45.672061816 156.263771574 -45.672093683 156.263903014 -45.672216711
2022-03-24 12:38:24,833 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 11
2022-03-24 12:38:24,833 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 136 1617
2022-03-24 12:38:24,834 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1837 1860
2022-03-24 12:38:25,044 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:25,053 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.264900700 -45.673185083 156.264769161 -45.673061972 156.264706280 -45.673093849 156.264837816 -45.673216961
2022-03-24 12:38:25,054 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.264900700 -45.673185083 156.264769161 -45.673061972 156.264706280 -45.673093849 156.264837816 -45.673216961
2022-03-24 12:38:25,911 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 14
2022-03-24 12:38:25,912 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 104 1582
2022-03-24 12:38:25,912 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1222 1243
2022-03-24 12:38:26,119 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:26,127 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.249021000 -45.658685479 156.248891047 -45.658563629 156.248828487 -45.658595378 156.248958437 -45.658717230
2022-03-24 12:38:26,128 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.249021000 -45.658685479 156.248891047 -45.658563629 156.248828487 -45.658595378 156.248958437 -45.658717230
2022-03-24 12:38:27,782 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 15
2022-03-24 12:38:27,782 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 122 1604
2022-03-24 12:38:27,783 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1887 1910
2022-03-24 12:38:27,989 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:27,997 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.265657550 -45.674645528 156.265525910 -45.674522304 156.265463012 -45.674554193 156.265594650 -45.674677417
2022-03-24 12:38:27,998 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.265657550 -45.674645528 156.265525910 -45.674522304 156.265463012 -45.674554193 156.265594650 -45.674677417
2022-03-24 12:38:29,615 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 16
2022-03-24 12:38:29,616 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 117 1598
2022-03-24 12:38:29,616 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1822 1845
2022-03-24 12:38:29,826 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:29,835 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.263909649 -45.673134588 156.263778173 -45.673011497 156.263715311 -45.673043371 156.263846784 -45.673166463
2022-03-24 12:38:29,836 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.263909649 -45.673134588 156.263778173 -45.673011497 156.263715311 -45.673043371 156.263846784 -45.673166463
2022-03-24 12:38:30,694 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 17
2022-03-24 12:38:30,695 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 115 1597
2022-03-24 12:38:30,695 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1852 1875
2022-03-24 12:38:30,903 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:30,911 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.264589177 -45.673896098 156.264457630 -45.673772943 156.264394753 -45.673804824 156.264526298 -45.673927980
2022-03-24 12:38:30,912 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.264589177 -45.673896098 156.264457630 -45.673772943 156.264394753 -45.673804824 156.264526298 -45.673927980
2022-03-24 12:38:32,607 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 18
2022-03-24 12:38:32,608 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 115 1597
2022-03-24 12:38:32,609 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1847 1870
2022-03-24 12:38:32,813 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:32,821 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.264461421 -45.673776492 156.264329887 -45.673653347 156.264267013 -45.673685227 156.264398544 -45.673808373
2022-03-24 12:38:32,822 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.264461421 -45.673776492 156.264329887 -45.673653347 156.264267013 -45.673685227 156.264398544 -45.673808373
2022-03-24 12:38:33,670 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 19
2022-03-24 12:38:33,671 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 93 1571
2022-03-24 12:38:33,671 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1337 1358
2022-03-24 12:38:33,878 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:33,887 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.251408362 -45.661673296 156.251278132 -45.661551203 156.251215522 -45.661582975 156.251345749 -45.661705069
2022-03-24 12:38:33,888 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.251408362 -45.661673296 156.251278132 -45.661551203 156.251215522 -45.661582975 156.251345749 -45.661705069
2022-03-24 12:38:34,734 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 21
2022-03-24 12:38:34,735 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 89 1568
2022-03-24 12:38:34,735 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1382 1403
2022-03-24 12:38:35,854 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:35,863 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.252374207 -45.662828704 156.252243867 -45.662706516 156.252181238 -45.662738296 156.252311575 -45.662860485
2022-03-24 12:38:35,864 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.252374207 -45.662828704 156.252243867 -45.662706516 156.252181238 -45.662738296 156.252311575 -45.662860485
2022-03-24 12:38:36,735 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 25
2022-03-24 12:38:36,736 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 70 1547
2022-03-24 12:38:36,736 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1277 1298
2022-03-24 12:38:36,942 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:36,950 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.249200048 -45.660601994 156.249070003 -45.660480012 156.249007436 -45.660511773 156.249137478 -45.660633755
2022-03-24 12:38:36,952 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.249200048 -45.660601994 156.249070003 -45.660480012 156.249007436 -45.660511773 156.249137478 -45.660633755
2022-03-24 12:38:38,575 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 26
2022-03-24 12:38:38,576 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 65 1544
2022-03-24 12:38:38,576 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1563 1584
2022-03-24 12:38:38,778 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:38,787 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.255900113 -45.667634746 156.255769353 -45.667512168 156.255706649 -45.667543987 156.255837406 -45.667666566
2022-03-24 12:38:38,788 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.255900113 -45.667634746 156.255769353 -45.667512168 156.255706649 -45.667543987 156.255837406 -45.667666566
2022-03-24 12:38:39,652 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 27
2022-03-24 12:38:39,652 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 31 1507
2022-03-24 12:38:39,653 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1202 1222
2022-03-24 12:38:39,855 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:39,863 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.246097982 -45.659439921 156.245968181 -45.659318074 156.245905674 -45.659349821 156.246035471 -45.659471670
2022-03-24 12:38:39,864 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.246097982 -45.659439921 156.245968181 -45.659318074 156.245905674 -45.659349821 156.246035471 -45.659471670
2022-03-24 12:38:40,694 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 29
2022-03-24 12:38:40,695 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 22 1503
2022-03-24 12:38:40,695 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1868 1889
2022-03-24 12:38:40,896 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:40,905 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.261846987 -45.675840555 156.261715536 -45.675717309 156.261652705 -45.675749201 156.261784154 -45.675872448
2022-03-24 12:38:40,906 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.261846987 -45.675840555 156.261715536 -45.675717309 156.261652705 -45.675749201 156.261784154 -45.675872448
2022-03-24 12:38:42,697 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 31
2022-03-24 12:38:42,697 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1464
2022-03-24 12:38:42,698 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1368 1388
2022-03-24 12:38:42,901 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:42,909 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.248622769 -45.664184605 156.248492610 -45.664062392 156.248430047 -45.664094174 156.248560203 -45.664216388
2022-03-24 12:38:42,910 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.248622769 -45.664184605 156.248492610 -45.664062392 156.248430047 -45.664094174 156.248560203 -45.664216388
2022-03-24 12:38:43,765 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 32
2022-03-24 12:38:43,766 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1432
2022-03-24 12:38:43,766 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1353 1372
2022-03-24 12:38:44,817 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:44,826 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.247206881 -45.664355302 156.247076805 -45.664233103 156.247014266 -45.664264884 156.247144339 -45.664387085
2022-03-24 12:38:44,827 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.247206881 -45.664355302 156.247076805 -45.664233103 156.247014266 -45.664264884 156.247144339 -45.664387085
2022-03-24 12:38:45,681 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 33
2022-03-24 12:38:45,681 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1418
2022-03-24 12:38:45,682 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1273 1292
2022-03-24 12:38:45,883 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:45,891 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.244841867 -45.662633161 156.244712012 -45.662511121 156.244649520 -45.662542887 156.244779372 -45.662664928
2022-03-24 12:38:45,893 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.244841867 -45.662633161 156.244712012 -45.662511121 156.244649520 -45.662542887 156.244779372 -45.662664928
2022-03-24 12:38:46,730 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 35
2022-03-24 12:38:46,730 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1428
2022-03-24 12:38:46,731 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1723 1744
2022-03-24 12:38:47,793 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:47,802 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.255896650 -45.673517700 156.255765657 -45.673394713 156.255702938 -45.673426578 156.255833929 -45.673549566
2022-03-24 12:38:47,803 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.255896650 -45.673517700 156.255765657 -45.673394713 156.255702938 -45.673426578 156.255833929 -45.673549566
2022-03-24 12:38:48,648 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 37
2022-03-24 12:38:48,649 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1412
2022-03-24 12:38:48,649 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1664 1683
2022-03-24 12:38:48,852 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:48,861 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.253937935 -45.672305027 156.253807112 -45.672182158 156.253744431 -45.672214010 156.253875252 -45.672336880
2022-03-24 12:38:48,862 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.253937935 -45.672305027 156.253807112 -45.672182158 156.253744431 -45.672214010 156.253875252 -45.672336880
2022-03-24 12:38:49,700 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 38
2022-03-24 12:38:49,700 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1404
2022-03-24 12:38:49,701 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1604 1623
2022-03-24 12:38:49,899 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:49,908 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.252241050 -45.670961715 156.252110387 -45.670838969 156.252047741 -45.670870808 156.252178401 -45.670993555
2022-03-24 12:38:49,909 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.252241050 -45.670961715 156.252110387 -45.670838969 156.252047741 -45.670870808 156.252178401 -45.670993555
2022-03-24 12:38:51,627 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 39
2022-03-24 12:38:51,628 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1385
2022-03-24 12:38:51,628 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1243 1262
2022-03-24 12:38:51,831 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:51,839 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.243049984 -45.662448591 156.242920250 -45.662326596 156.242857790 -45.662358358 156.242987521 -45.662480354
2022-03-24 12:38:51,840 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.243049984 -45.662448591 156.242920250 -45.662326596 156.242857790 -45.662358358 156.242987521 -45.662480354
2022-03-24 12:38:52,702 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 41
2022-03-24 12:38:52,703 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1393
2022-03-24 12:38:52,703 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1769 1788
2022-03-24 12:38:52,904 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:52,912 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.255829101 -45.675209536 156.255698046 -45.675086431 156.255635323 -45.675118310 156.255766375 -45.675241415
2022-03-24 12:38:52,913 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.255829101 -45.675209536 156.255698046 -45.675086431 156.255635323 -45.675118310 156.255766375 -45.675241415
2022-03-24 12:38:54,653 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 53
2022-03-24 12:38:54,653 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 819
2022-03-24 12:38:54,654 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1316 1329
2022-03-24 12:38:54,849 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:54,858 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.226123221 -45.673642180 156.225994086 -45.673519691 156.225931834 -45.673551545 156.226060967 -45.673674035
2022-03-24 12:38:54,859 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.226123221 -45.673642180 156.225994086 -45.673519691 156.225931834 -45.673551545 156.226060967 -45.673674035
2022-03-24 12:38:55,693 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 54
2022-03-24 12:38:55,694 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 819
2022-03-24 12:38:55,694 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1306 1319
2022-03-24 12:38:55,887 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:55,895 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.225872406 -45.673404272 156.225743296 -45.673281804 156.225681049 -45.673313656 156.225810156 -45.673436124
2022-03-24 12:38:55,897 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.225872406 -45.673404272 156.225743296 -45.673281804 156.225681049 -45.673313656 156.225810156 -45.673436124
2022-03-24 12:38:57,661 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 1
2022-03-24 12:38:57,661 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 118 1591
2022-03-24 12:38:57,662 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 34 53
2022-03-24 12:38:57,872 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:57,882 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.221266819 -45.630196596 156.221139727 -45.630076839 156.221077689 -45.630108429 156.221204778 -45.630228186
2022-03-24 12:38:57,884 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.221266819 -45.630196596 156.221139727 -45.630076839 156.221077689 -45.630108429 156.221204778 -45.630228186
2022-03-24 12:38:58,759 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 2
2022-03-24 12:38:58,759 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 124 1598
2022-03-24 12:38:58,760 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 332 351
2022-03-24 12:38:58,961 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:38:58,970 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.228476955 -45.637109572 156.228349188 -45.636989367 156.228287022 -45.637020983 156.228414786 -45.637141189
2022-03-24 12:38:58,971 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.228476955 -45.637109572 156.228349188 -45.636989367 156.228287022 -45.637020983 156.228414786 -45.637141189
2022-03-24 12:39:00,773 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 3
2022-03-24 12:39:00,774 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 116 1589
2022-03-24 12:39:00,774 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 55 73
2022-03-24 12:39:00,976 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:00,985 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.221674541 -45.630705151 156.221547408 -45.630585366 156.221485363 -45.630616957 156.221612493 -45.630736743
2022-03-24 12:39:00,986 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.221674541 -45.630705151 156.221547408 -45.630585366 156.221485363 -45.630616957 156.221612493 -45.630736743
2022-03-24 12:39:01,839 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 4
2022-03-24 12:39:01,839 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 111 1584
2022-03-24 12:39:01,840 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 161 179
2022-03-24 12:39:02,040 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:02,049 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.224010549 -45.633278787 156.223883188 -45.633158845 156.223821102 -45.633190445 156.223948460 -45.633310387
2022-03-24 12:39:02,051 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.224010549 -45.633278787 156.223883188 -45.633158845 156.223821102 -45.633190445 156.223948460 -45.633310387
2022-03-24 12:39:03,820 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 5
2022-03-24 12:39:03,821 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 99 1573
2022-03-24 12:39:03,821 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 307 326
2022-03-24 12:39:04,023 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:04,032 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.227084510 -45.636919416 156.226956832 -45.636799245 156.226894691 -45.636830857 156.227022367 -45.636951029
2022-03-24 12:39:04,033 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.227084510 -45.636919416 156.226956832 -45.636799245 156.226894691 -45.636830857 156.227022367 -45.636951029
2022-03-24 12:39:04,894 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 12
2022-03-24 12:39:04,895 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 91 1566
2022-03-24 12:39:04,896 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 484 503
2022-03-24 12:39:05,097 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:05,106 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.230998580 -45.641224458 156.230870498 -45.641103991 156.230808285 -45.641135623 156.230936364 -45.641256090
2022-03-24 12:39:05,107 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.230998580 -45.641224458 156.230870498 -45.641103991 156.230808285 -45.641135623 156.230936364 -45.641256090
2022-03-24 12:39:05,939 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 13
2022-03-24 12:39:05,941 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 80 1553
2022-03-24 12:39:05,941 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 95 113
2022-03-24 12:39:06,139 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:06,148 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.221461889 -45.632246282 156.221334710 -45.632126430 156.221272668 -45.632158022 156.221399846 -45.632277874
2022-03-24 12:39:06,150 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.221461889 -45.632246282 156.221334710 -45.632126430 156.221272668 -45.632158022 156.221399846 -45.632277874
2022-03-24 12:39:08,014 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 20
2022-03-24 12:39:08,015 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 76 1551
2022-03-24 12:39:08,016 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 751 770
2022-03-24 12:39:08,223 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:08,232 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.236828252 -45.647826217 156.236699542 -45.647705266 156.236637217 -45.647736933 156.236765924 -45.647857884
2022-03-24 12:39:08,233 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.236828252 -45.647826217 156.236699542 -45.647705266 156.236637217 -45.647736933 156.236765924 -45.647857884
2022-03-24 12:39:09,226 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 22
2022-03-24 12:39:09,227 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 68 1542
2022-03-24 12:39:09,228 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 645 664
2022-03-24 12:39:09,453 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:09,463 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.234035860 -45.645450737 156.233907420 -45.645329977 156.233845148 -45.645361628 156.233973585 -45.645482389
2022-03-24 12:39:09,464 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.234035860 -45.645450737 156.233907420 -45.645329977 156.233845148 -45.645361628 156.233973585 -45.645482389
2022-03-24 12:39:12,314 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 23
2022-03-24 12:39:12,314 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 52 1525
2022-03-24 12:39:12,315 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 116 133
2022-03-24 12:39:12,517 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:12,526 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.221012951 -45.633191592 156.220885760 -45.633071703 156.220823726 -45.633103294 156.220950915 -45.633223183
2022-03-24 12:39:12,527 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.221012951 -45.633191592 156.220885760 -45.633071703 156.220823726 -45.633103294 156.220950915 -45.633223183
2022-03-24 12:39:13,418 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 24
2022-03-24 12:39:13,423 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 69 1545
2022-03-24 12:39:13,423 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 786 805
2022-03-24 12:39:13,660 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:13,669 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.237444560 -45.648779316 156.237315772 -45.648658296 156.237253434 -45.648689968 156.237382219 -45.648810988
2022-03-24 12:39:13,670 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.237444560 -45.648779316 156.237315772 -45.648658296 156.237253434 -45.648689968 156.237382219 -45.648810988
2022-03-24 12:39:15,551 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 28
2022-03-24 12:39:15,551 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 11 1485
2022-03-24 12:39:15,552 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 661 679
2022-03-24 12:39:15,754 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:15,763 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.232517711 -45.646764241 156.232389309 -45.646643431 156.232327062 -45.646675084 156.232455462 -45.646795894
2022-03-24 12:39:15,764 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.232517711 -45.646764241 156.232389309 -45.646643431 156.232327062 -45.646675084 156.232455462 -45.646795894
2022-03-24 12:39:16,618 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 30
2022-03-24 12:39:16,619 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1457
2022-03-24 12:39:16,619 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 701 719
2022-03-24 12:39:16,822 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:16,831 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.232568977 -45.648183467 156.232440513 -45.648062572 156.232378263 -45.648094230 156.232506725 -45.648215126
2022-03-24 12:39:16,832 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.232568977 -45.648183467 156.232440513 -45.648062572 156.232378263 -45.648094230 156.232506725 -45.648215126
2022-03-24 12:39:17,671 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 34
2022-03-24 12:39:17,672 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1394
2022-03-24 12:39:17,673 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 717 734
2022-03-24 12:39:17,869 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:17,878 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.230879662 -45.649585075 156.230751242 -45.649464125 156.230689019 -45.649495787 156.230817437 -45.649616737
2022-03-24 12:39:17,879 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.230879662 -45.649585075 156.230751242 -45.649464125 156.230689019 -45.649495787 156.230817437 -45.649616737
2022-03-24 12:39:19,781 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 36
2022-03-24 12:39:19,782 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1377
2022-03-24 12:39:19,782 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 450 466
2022-03-24 12:39:19,980 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:19,989 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.224033871 -45.643507774 156.223906106 -45.643387302 156.223844011 -45.643418924 156.223971774 -45.643539396
2022-03-24 12:39:19,990 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.224033871 -45.643507774 156.223906106 -45.643387302 156.223844011 -45.643418924 156.223971774 -45.643539396
2022-03-24 12:39:20,841 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 40
2022-03-24 12:39:20,841 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1343
2022-03-24 12:39:20,842 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 218 234
2022-03-24 12:39:21,040 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:21,049 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.217486084 -45.638574970 156.217358883 -45.638454874 156.217296902 -45.638486467 156.217424102 -45.638606563
2022-03-24 12:39:21,051 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.217486084 -45.638574970 156.217358883 -45.638454874 156.217296902 -45.638486467 156.217424102 -45.638606563
2022-03-24 12:39:22,908 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 42
2022-03-24 12:39:22,908 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1296
2022-03-24 12:39:22,909 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 546 562
2022-03-24 12:39:23,106 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:23,115 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.223646010 -45.647128995 156.223518121 -45.647008321 156.223456024 -45.647039957 156.223583911 -45.647160632
2022-03-24 12:39:23,116 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.223646010 -45.647128995 156.223518121 -45.647008321 156.223456024 -45.647039957 156.223583911 -45.647160632
2022-03-24 12:39:23,963 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 43
2022-03-24 12:39:23,963 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1246
2022-03-24 12:39:23,964 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 415 430
2022-03-24 12:39:24,164 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:24,173 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218966486 -45.644829601 156.218838959 -45.644709141 156.218776943 -45.644740759 156.218904467 -45.644861220
2022-03-24 12:39:24,174 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218966486 -45.644829601 156.218838959 -45.644709141 156.218776943 -45.644740759 156.218904467 -45.644861220
2022-03-24 12:39:25,001 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 44
2022-03-24 12:39:25,001 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1246
2022-03-24 12:39:25,002 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 405 420
2022-03-24 12:39:25,199 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:25,208 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218718991 -45.644595818 156.218591488 -45.644475376 156.218529475 -45.644506992 156.218656977 -45.644627436
2022-03-24 12:39:25,209 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218718991 -45.644595818 156.218591488 -45.644475376 156.218529475 -45.644506992 156.218656977 -45.644627436
2022-03-24 12:39:27,145 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 45
2022-03-24 12:39:27,146 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1185
2022-03-24 12:39:27,146 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 531 546
2022-03-24 12:39:27,341 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:27,350 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.219673020 -45.648613077 156.219545303 -45.648492383 156.219483265 -45.648524021 156.219610979 -45.648644716
2022-03-24 12:39:27,351 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.219673020 -45.648613077 156.219545303 -45.648492383 156.219483265 -45.648524021 156.219610979 -45.648644716
2022-03-24 12:39:28,203 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 46
2022-03-24 12:39:28,203 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1158
2022-03-24 12:39:28,203 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 203 218
2022-03-24 12:39:28,398 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:28,406 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.211127421 -45.641279813 156.211000463 -45.641159678 156.210938572 -45.641191268 156.211065527 -45.641311404
2022-03-24 12:39:28,408 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.211127421 -45.641279813 156.211000463 -45.641159678 156.210938572 -45.641191268 156.211065527 -45.641311404
2022-03-24 12:39:30,278 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 47
2022-03-24 12:39:30,279 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1091
2022-03-24 12:39:30,280 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 567 581
2022-03-24 12:39:30,472 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:30,481 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.217456055 -45.651006881 156.217328370 -45.650886079 156.217266356 -45.650917729 156.217394038 -45.651038531
2022-03-24 12:39:30,482 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.217456055 -45.651006881 156.217328370 -45.650886079 156.217266356 -45.650917729 156.217394038 -45.651038531
2022-03-24 12:39:31,333 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 48
2022-03-24 12:39:31,334 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1091
2022-03-24 12:39:31,334 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 562 576
2022-03-24 12:39:31,530 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:31,539 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.217332149 -45.650889654 156.217204477 -45.650768862 156.217142464 -45.650800511 156.217270135 -45.650921304
2022-03-24 12:39:31,540 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.217332149 -45.650889654 156.217204477 -45.650768862 156.217142464 -45.650800511 156.217270135 -45.650921304
2022-03-24 12:39:32,364 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 49
2022-03-24 12:39:32,364 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1067
2022-03-24 12:39:32,365 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 633 647
2022-03-24 12:39:32,557 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:32,566 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.218210913 -45.652969013 156.218083107 -45.652848076 156.218021073 -45.652879740 156.218148877 -45.653000678
2022-03-24 12:39:32,568 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.218210913 -45.652969013 156.218083107 -45.652848076 156.218021073 -45.652879740 156.218148877 -45.653000678
2022-03-24 12:39:34,516 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 50
2022-03-24 12:39:34,517 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1048
2022-03-24 12:39:34,517 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 239 253
2022-03-24 12:39:34,711 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:34,720 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.208399869 -45.643929179 156.208272959 -45.643808942 156.208211096 -45.643840541 156.208338005 -45.643960778
2022-03-24 12:39:34,721 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.208399869 -45.643929179 156.208272959 -45.643808942 156.208211096 -45.643840541 156.208338005 -45.643960778
2022-03-24 12:39:35,572 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 51
2022-03-24 12:39:35,573 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 1034
2022-03-24 12:39:35,574 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 431 445
2022-03-24 12:39:35,772 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:35,781 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.212403238 -45.648718689 156.212275928 -45.648598111 156.212213993 -45.648629742 156.212341301 -45.648750320
2022-03-24 12:39:35,782 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.212403238 -45.648718689 156.212275928 -45.648598111 156.212213993 -45.648629742 156.212341301 -45.648750320
2022-03-24 12:39:36,607 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 52
2022-03-24 12:39:36,608 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 998
2022-03-24 12:39:36,609 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 804 818
2022-03-24 12:39:36,802 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:36,811 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.219947139 -45.658234585 156.219819020 -45.658113276 156.219756938 -45.658144979 156.219885055 -45.658266289
2022-03-24 12:39:36,812 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.219947139 -45.658234585 156.219819020 -45.658113276 156.219756938 -45.658144979 156.219885055 -45.658266289
2022-03-24 12:39:38,767 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 55
2022-03-24 12:39:38,768 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 297
2022-03-24 12:39:38,769 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 1416 1426
2022-03-24 12:39:38,955 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:38,964 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.211226719 -45.684941334 156.211098073 -45.684818233 156.211035880 -45.684850241 156.211164524 -45.684973343
2022-03-24 12:39:38,965 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.211226719 -45.684941334 156.211098073 -45.684818233 156.211035880 -45.684850241 156.211164524 -45.684973343
2022-03-24 12:39:39,798 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 56
2022-03-24 12:39:39,799 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 143
2022-03-24 12:39:39,799 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 769 778
2022-03-24 12:39:39,984 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:39,993 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.191122501 -45.671742959 156.190995485 -45.671621176 156.190933579 -45.671653049 156.191060593 -45.671774833
2022-03-24 12:39:39,994 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.191122501 -45.671742959 156.190995485 -45.671621176 156.190933579 -45.671653049 156.191060593 -45.671774833
2022-03-24 12:39:40,806 - stpipe.Extract2dStep - INFO - Name of subarray extracted: 57
2022-03-24 12:39:40,807 - stpipe.Extract2dStep - INFO - Subarray x-extents are: 0 74
2022-03-24 12:39:40,808 - stpipe.Extract2dStep - INFO - Subarray y-extents are: 355 365
2022-03-24 12:39:40,992 - stpipe.Extract2dStep - INFO - set slit_attributes completed
2022-03-24 12:39:41,001 - stpipe.Extract2dStep - INFO - Update S_REGION to POLYGON ICRS 156.179343124 -45.662963603 156.179216994 -45.662842617 156.179155236 -45.662874401 156.179281365 -45.662995389
2022-03-24 12:39:41,003 - stpipe.Extract2dStep - INFO - Updated S_REGION to POLYGON ICRS 156.179343124 -45.662963603 156.179216994 -45.662842617 156.179155236 -45.662874401 156.179281365 -45.662995389
2022-03-24 12:39:45,285 - stpipe.Extract2dStep - INFO - Step Extract2dStep done
2022-03-24 12:39:48,231 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2022-03-24 12:39:49,265 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<MultiSlitModel from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:39:49,267 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:39:49,275 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_MSASPEC
2022-03-24 12:39:49,277 - stpipe.SourceTypeStep - INFO - source_id=6, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,278 - stpipe.SourceTypeStep - INFO - source_id=7, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,279 - stpipe.SourceTypeStep - INFO - source_id=8, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,280 - stpipe.SourceTypeStep - INFO - source_id=9, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,282 - stpipe.SourceTypeStep - INFO - source_id=10, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,283 - stpipe.SourceTypeStep - INFO - source_id=11, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,284 - stpipe.SourceTypeStep - INFO - source_id=14, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,285 - stpipe.SourceTypeStep - INFO - source_id=15, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,287 - stpipe.SourceTypeStep - INFO - source_id=16, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,288 - stpipe.SourceTypeStep - INFO - source_id=17, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,289 - stpipe.SourceTypeStep - INFO - source_id=18, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,290 - stpipe.SourceTypeStep - INFO - source_id=19, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,291 - stpipe.SourceTypeStep - INFO - source_id=21, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,292 - stpipe.SourceTypeStep - INFO - source_id=25, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,293 - stpipe.SourceTypeStep - INFO - source_id=26, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,295 - stpipe.SourceTypeStep - INFO - source_id=27, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,296 - stpipe.SourceTypeStep - INFO - source_id=29, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,297 - stpipe.SourceTypeStep - INFO - source_id=31, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,298 - stpipe.SourceTypeStep - INFO - source_id=32, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,299 - stpipe.SourceTypeStep - INFO - source_id=33, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,300 - stpipe.SourceTypeStep - INFO - source_id=35, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,301 - stpipe.SourceTypeStep - INFO - source_id=37, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,302 - stpipe.SourceTypeStep - INFO - source_id=38, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,304 - stpipe.SourceTypeStep - INFO - source_id=39, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,305 - stpipe.SourceTypeStep - INFO - source_id=41, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,306 - stpipe.SourceTypeStep - INFO - source_id=53, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,307 - stpipe.SourceTypeStep - INFO - source_id=54, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,308 - stpipe.SourceTypeStep - INFO - source_id=1, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,309 - stpipe.SourceTypeStep - INFO - source_id=2, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,310 - stpipe.SourceTypeStep - INFO - source_id=3, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,311 - stpipe.SourceTypeStep - INFO - source_id=4, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,312 - stpipe.SourceTypeStep - INFO - source_id=5, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,314 - stpipe.SourceTypeStep - INFO - source_id=12, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,315 - stpipe.SourceTypeStep - INFO - source_id=13, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,316 - stpipe.SourceTypeStep - INFO - source_id=20, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,317 - stpipe.SourceTypeStep - INFO - source_id=22, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,318 - stpipe.SourceTypeStep - INFO - source_id=23, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,319 - stpipe.SourceTypeStep - INFO - source_id=24, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,321 - stpipe.SourceTypeStep - INFO - source_id=28, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,322 - stpipe.SourceTypeStep - INFO - source_id=30, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,324 - stpipe.SourceTypeStep - INFO - source_id=34, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,325 - stpipe.SourceTypeStep - INFO - source_id=36, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,326 - stpipe.SourceTypeStep - INFO - source_id=40, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,327 - stpipe.SourceTypeStep - INFO - source_id=42, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,328 - stpipe.SourceTypeStep - INFO - source_id=43, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,329 - stpipe.SourceTypeStep - INFO - source_id=44, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,331 - stpipe.SourceTypeStep - INFO - source_id=45, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,332 - stpipe.SourceTypeStep - INFO - source_id=46, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,333 - stpipe.SourceTypeStep - INFO - source_id=47, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,334 - stpipe.SourceTypeStep - INFO - source_id=48, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,335 - stpipe.SourceTypeStep - INFO - source_id=49, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,336 - stpipe.SourceTypeStep - INFO - source_id=50, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,337 - stpipe.SourceTypeStep - INFO - source_id=51, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,339 - stpipe.SourceTypeStep - INFO - source_id=52, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,340 - stpipe.SourceTypeStep - INFO - source_id=55, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,341 - stpipe.SourceTypeStep - INFO - source_id=56, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,342 - stpipe.SourceTypeStep - INFO - source_id=57, stellarity=0.0000, type=EXTENDED
2022-03-24 12:39:49,345 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2022-03-24 12:39:49,460 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2022-03-24 12:39:50,334 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<MultiSlitModel from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:39:50,336 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:39:50,449 - stpipe.WavecorrStep - INFO - Using WAVECORR reference file /grp/crds/cache/references/jwst/jwst_nirspec_wavecorr_0004.asdf
2022-03-24 12:40:02,117 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 6
2022-03-24 12:40:02,118 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 7
2022-03-24 12:40:02,118 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 8
2022-03-24 12:40:02,119 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 9
2022-03-24 12:40:02,119 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 10
2022-03-24 12:40:02,120 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 11
2022-03-24 12:40:02,120 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 14
2022-03-24 12:40:02,121 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 15
2022-03-24 12:40:02,122 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 16
2022-03-24 12:40:02,122 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 17
2022-03-24 12:40:02,123 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 18
2022-03-24 12:40:02,123 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 19
2022-03-24 12:40:02,123 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 21
2022-03-24 12:40:02,124 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 25
2022-03-24 12:40:02,125 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 26
2022-03-24 12:40:02,126 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 27
2022-03-24 12:40:02,126 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 29
2022-03-24 12:40:02,127 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 31
2022-03-24 12:40:02,127 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 32
2022-03-24 12:40:02,128 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 33
2022-03-24 12:40:02,128 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 35
2022-03-24 12:40:02,128 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 37
2022-03-24 12:40:02,129 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 38
2022-03-24 12:40:02,129 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 39
2022-03-24 12:40:02,130 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 41
2022-03-24 12:40:02,130 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 53
2022-03-24 12:40:02,131 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 54
2022-03-24 12:40:02,131 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 1
2022-03-24 12:40:02,132 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 2
2022-03-24 12:40:02,132 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 3
2022-03-24 12:40:02,132 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 4
2022-03-24 12:40:02,133 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 5
2022-03-24 12:40:02,133 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 12
2022-03-24 12:40:02,134 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 13
2022-03-24 12:40:02,134 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 20
2022-03-24 12:40:02,135 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 22
2022-03-24 12:40:02,135 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 23
2022-03-24 12:40:02,136 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 24
2022-03-24 12:40:02,136 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 28
2022-03-24 12:40:02,136 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 30
2022-03-24 12:40:02,137 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 34
2022-03-24 12:40:02,138 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 36
2022-03-24 12:40:02,138 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 40
2022-03-24 12:40:02,138 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 42
2022-03-24 12:40:02,139 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 43
2022-03-24 12:40:02,139 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 44
2022-03-24 12:40:02,140 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 45
2022-03-24 12:40:02,140 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 46
2022-03-24 12:40:02,141 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 47
2022-03-24 12:40:02,141 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 48
2022-03-24 12:40:02,142 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 49
2022-03-24 12:40:02,142 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 50
2022-03-24 12:40:02,142 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 51
2022-03-24 12:40:02,143 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 52
2022-03-24 12:40:02,143 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 55
2022-03-24 12:40:02,144 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 56
2022-03-24 12:40:02,144 - stpipe.WavecorrStep - INFO - Detected a EXTENDED source type in slit 57
2022-03-24 12:40:02,149 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2022-03-24 12:40:02,252 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2022-03-24 12:40:03,828 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<MultiSlitModel from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:40:03,833 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-03-24 12:40:34,408 - stpipe.FlatFieldStep - INFO - Working on slit 6
2022-03-24 12:40:36,737 - stpipe.FlatFieldStep - INFO - Working on slit 7
2022-03-24 12:40:39,049 - stpipe.FlatFieldStep - INFO - Working on slit 8
2022-03-24 12:40:41,352 - stpipe.FlatFieldStep - INFO - Working on slit 9
2022-03-24 12:40:43,688 - stpipe.FlatFieldStep - INFO - Working on slit 10
2022-03-24 12:40:45,988 - stpipe.FlatFieldStep - INFO - Working on slit 11
2022-03-24 12:40:48,349 - stpipe.FlatFieldStep - INFO - Working on slit 14
2022-03-24 12:40:50,935 - stpipe.FlatFieldStep - INFO - Working on slit 15
2022-03-24 12:40:53,306 - stpipe.FlatFieldStep - INFO - Working on slit 16
2022-03-24 12:40:55,894 - stpipe.FlatFieldStep - INFO - Working on slit 17
2022-03-24 12:40:58,356 - stpipe.FlatFieldStep - INFO - Working on slit 18
2022-03-24 12:41:00,660 - stpipe.FlatFieldStep - INFO - Working on slit 19
2022-03-24 12:41:02,928 - stpipe.FlatFieldStep - INFO - Working on slit 21
2022-03-24 12:41:05,135 - stpipe.FlatFieldStep - INFO - Working on slit 25
2022-03-24 12:41:07,319 - stpipe.FlatFieldStep - INFO - Working on slit 26
2022-03-24 12:41:09,476 - stpipe.FlatFieldStep - INFO - Working on slit 27
2022-03-24 12:41:11,640 - stpipe.FlatFieldStep - INFO - Working on slit 29
2022-03-24 12:41:13,785 - stpipe.FlatFieldStep - INFO - Working on slit 31
2022-03-24 12:41:15,933 - stpipe.FlatFieldStep - INFO - Working on slit 32
2022-03-24 12:41:18,030 - stpipe.FlatFieldStep - INFO - Working on slit 33
2022-03-24 12:41:20,128 - stpipe.FlatFieldStep - INFO - Working on slit 35
2022-03-24 12:41:22,241 - stpipe.FlatFieldStep - INFO - Working on slit 37
2022-03-24 12:41:24,302 - stpipe.FlatFieldStep - INFO - Working on slit 38
2022-03-24 12:41:26,349 - stpipe.FlatFieldStep - INFO - Working on slit 39
2022-03-24 12:41:28,383 - stpipe.FlatFieldStep - INFO - Working on slit 41
2022-03-24 12:41:30,402 - stpipe.FlatFieldStep - INFO - Working on slit 53
2022-03-24 12:41:31,650 - stpipe.FlatFieldStep - INFO - Working on slit 54
2022-03-24 12:41:32,893 - stpipe.FlatFieldStep - INFO - Working on slit 1
2022-03-24 12:41:35,052 - stpipe.FlatFieldStep - INFO - Working on slit 2
2022-03-24 12:41:37,203 - stpipe.FlatFieldStep - INFO - Working on slit 3
2022-03-24 12:41:39,346 - stpipe.FlatFieldStep - INFO - Working on slit 4
2022-03-24 12:41:41,490 - stpipe.FlatFieldStep - INFO - Working on slit 5
2022-03-24 12:41:44,894 - stpipe.FlatFieldStep - INFO - Working on slit 12
2022-03-24 12:41:47,045 - stpipe.FlatFieldStep - INFO - Working on slit 13
2022-03-24 12:41:49,204 - stpipe.FlatFieldStep - INFO - Working on slit 20
2022-03-24 12:41:51,324 - stpipe.FlatFieldStep - INFO - Working on slit 22
2022-03-24 12:41:53,505 - stpipe.FlatFieldStep - INFO - Working on slit 23
2022-03-24 12:41:55,677 - stpipe.FlatFieldStep - INFO - Working on slit 24
2022-03-24 12:41:57,860 - stpipe.FlatFieldStep - INFO - Working on slit 28
2022-03-24 12:42:00,041 - stpipe.FlatFieldStep - INFO - Working on slit 30
2022-03-24 12:42:02,204 - stpipe.FlatFieldStep - INFO - Working on slit 34
2022-03-24 12:42:04,261 - stpipe.FlatFieldStep - INFO - Working on slit 36
2022-03-24 12:42:06,298 - stpipe.FlatFieldStep - INFO - Working on slit 40
2022-03-24 12:42:08,292 - stpipe.FlatFieldStep - INFO - Working on slit 42
2022-03-24 12:42:10,167 - stpipe.FlatFieldStep - INFO - Working on slit 43
2022-03-24 12:42:11,976 - stpipe.FlatFieldStep - INFO - Working on slit 44
2022-03-24 12:42:13,793 - stpipe.FlatFieldStep - INFO - Working on slit 45
2022-03-24 12:42:15,549 - stpipe.FlatFieldStep - INFO - Working on slit 46
2022-03-24 12:42:17,264 - stpipe.FlatFieldStep - INFO - Working on slit 47
2022-03-24 12:42:18,868 - stpipe.FlatFieldStep - INFO - Working on slit 48
2022-03-24 12:42:20,477 - stpipe.FlatFieldStep - INFO - Working on slit 49
2022-03-24 12:42:22,044 - stpipe.FlatFieldStep - INFO - Working on slit 50
2022-03-24 12:42:23,617 - stpipe.FlatFieldStep - INFO - Working on slit 51
2022-03-24 12:42:25,105 - stpipe.FlatFieldStep - INFO - Working on slit 52
2022-03-24 12:42:26,591 - stpipe.FlatFieldStep - INFO - Working on slit 55
2022-03-24 12:42:27,125 - stpipe.FlatFieldStep - INFO - Working on slit 56
2022-03-24 12:42:27,461 - stpipe.FlatFieldStep - INFO - Working on slit 57
2022-03-24 12:42:31,871 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
2022-03-24 12:42:31,970 - stpipe.PathLossStep - INFO - PathLossStep instance created.
2022-03-24 12:42:33,326 - stpipe.PathLossStep - INFO - Step PathLossStep running with args (<MultiSlitModel from mos_g140m_line1_NRS2_uncal.fits>,).
2022-03-24 12:42:33,330 - stpipe.PathLossStep - INFO - Step PathLossStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-03-24 12:42:33,439 - stpipe.PathLossStep - INFO - Using PATHLOSS reference file /grp/crds/cache/references/jwst/jwst_nirspec_pathloss_0002.fits
2022-03-24 12:42:33,493 - stpipe.PathLossStep - INFO - Input exposure type is NRS_MSASPEC
2022-03-24 12:42:45,396 - stpipe.PathLossStep - INFO - Working on slit 0
2022-03-24 12:42:45,419 - stpipe.PathLossStep - INFO - Working on slit 1
2022-03-24 12:42:45,441 - stpipe.PathLossStep - INFO - Working on slit 2
2022-03-24 12:42:45,461 - stpipe.PathLossStep - INFO - Working on slit 3
2022-03-24 12:42:45,482 - stpipe.PathLossStep - INFO - Working on slit 4
2022-03-24 12:42:45,504 - stpipe.PathLossStep - INFO - Working on slit 5
2022-03-24 12:42:45,524 - stpipe.PathLossStep - INFO - Working on slit 6
2022-03-24 12:42:45,544 - stpipe.PathLossStep - INFO - Working on slit 7
2022-03-24 12:42:45,565 - stpipe.PathLossStep - INFO - Working on slit 8
2022-03-24 12:42:45,585 - stpipe.PathLossStep - INFO - Working on slit 9
2022-03-24 12:42:45,605 - stpipe.PathLossStep - INFO - Working on slit 10
2022-03-24 12:42:45,626 - stpipe.PathLossStep - INFO - Working on slit 11
2022-03-24 12:42:45,646 - stpipe.PathLossStep - INFO - Working on slit 12
2022-03-24 12:42:45,667 - stpipe.PathLossStep - INFO - Working on slit 13
2022-03-24 12:42:45,688 - stpipe.PathLossStep - INFO - Working on slit 14
2022-03-24 12:42:45,709 - stpipe.PathLossStep - INFO - Working on slit 15
2022-03-24 12:42:45,729 - stpipe.PathLossStep - INFO - Working on slit 16
2022-03-24 12:42:45,749 - stpipe.PathLossStep - INFO - Working on slit 17
2022-03-24 12:42:45,769 - stpipe.PathLossStep - INFO - Working on slit 18
2022-03-24 12:42:45,789 - stpipe.PathLossStep - INFO - Working on slit 19
2022-03-24 12:42:45,810 - stpipe.PathLossStep - INFO - Working on slit 20
2022-03-24 12:42:45,830 - stpipe.PathLossStep - INFO - Working on slit 21
2022-03-24 12:42:45,850 - stpipe.PathLossStep - INFO - Working on slit 22
2022-03-24 12:42:45,871 - stpipe.PathLossStep - INFO - Working on slit 23
2022-03-24 12:42:45,891 - stpipe.PathLossStep - INFO - Working on slit 24
2022-03-24 12:42:45,911 - stpipe.PathLossStep - INFO - Working on slit 25
2022-03-24 12:42:45,931 - stpipe.PathLossStep - INFO - Working on slit 26
2022-03-24 12:42:45,950 - stpipe.PathLossStep - INFO - Working on slit 27
2022-03-24 12:42:45,971 - stpipe.PathLossStep - INFO - Working on slit 28
2022-03-24 12:42:45,993 - stpipe.PathLossStep - INFO - Working on slit 29
2022-03-24 12:42:46,013 - stpipe.PathLossStep - INFO - Working on slit 30
2022-03-24 12:42:46,034 - stpipe.PathLossStep - INFO - Working on slit 31
2022-03-24 12:42:46,055 - stpipe.PathLossStep - INFO - Working on slit 32
2022-03-24 12:42:46,076 - stpipe.PathLossStep - INFO - Working on slit 33
2022-03-24 12:42:46,096 - stpipe.PathLossStep - INFO - Working on slit 34
2022-03-24 12:42:46,117 - stpipe.PathLossStep - INFO - Working on slit 35
2022-03-24 12:42:46,138 - stpipe.PathLossStep - INFO - Working on slit 36
2022-03-24 12:42:46,158 - stpipe.PathLossStep - INFO - Working on slit 37
2022-03-24 12:42:46,179 - stpipe.PathLossStep - INFO - Working on slit 38
2022-03-24 12:42:46,199 - stpipe.PathLossStep - INFO - Working on slit 39
2022-03-24 12:42:46,219 - stpipe.PathLossStep - INFO - Working on slit 40
2022-03-24 12:42:46,240 - stpipe.PathLossStep - INFO - Working on slit 41
2022-03-24 12:42:46,260 - stpipe.PathLossStep - INFO - Working on slit 42
2022-03-24 12:42:46,280 - stpipe.PathLossStep - INFO - Working on slit 43
2022-03-24 12:42:46,301 - stpipe.PathLossStep - INFO - Working on slit 44
2022-03-24 12:42:46,321 - stpipe.PathLossStep - INFO - Working on slit 45
2022-03-24 12:42:46,341 - stpipe.PathLossStep - INFO - Working on slit 46
2022-03-24 12:42:46,361 - stpipe.PathLossStep - INFO - Working on slit 47
2022-03-24 12:42:46,381 - stpipe.PathLossStep - INFO - Working on slit 48
2022-03-24 12:42:46,401 - stpipe.PathLossStep - INFO - Working on slit 49
2022-03-24 12:42:46,422 - stpipe.PathLossStep - INFO - Working on slit 50
2022-03-24 12:42:46,442 - stpipe.PathLossStep - INFO - Working on slit 51
2022-03-24 12:42:46,462 - stpipe.PathLossStep - INFO - Working on slit 52
2022-03-24 12:42:46,483 - stpipe.PathLossStep - INFO - Working on slit 53
2022-03-24 12:42:46,503 - stpipe.PathLossStep - INFO - Working on slit 54
2022-03-24 12:42:46,522 - stpipe.PathLossStep - INFO - Working on slit 55
2022-03-24 12:42:46,543 - stpipe.PathLossStep - INFO - Working on slit 56
2022-03-24 12:42:46,566 - stpipe.PathLossStep - INFO - Step PathLossStep done
Running test for MOS... Checking if files exist and obtaining datamodels. This takes a few minutes... from datamodel --> Detector: NRS2 Grating: G140M Filter: F100LP Lamp: LINE1 EXP_TYPE: NRS_MSASPEC Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0002.fits Looping through the slits... Retrieving reference file extensions Working with slitlet 6 Slitlet name in input file and in pathloss output file are the same. Retrieved extended/uniform source extension 3 slit_x, slit_y (-0.5, -0.5) Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.885e-08 median = 1.876e-08 stdev = 3.785e-08
Maximum AbsoluteDifference = 1.042e-07
Minimum AbsoluteDifference = -7.937e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.8853818900392972e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 7
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.947e-08 median = 1.906e-08 stdev = 3.814e-08
Maximum AbsoluteDifference = 1.073e-07
Minimum AbsoluteDifference = -8.366e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9472496187233387e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 8
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.052e-08 median = 2.056e-08 stdev = 3.815e-08
Maximum AbsoluteDifference = 1.080e-07
Minimum AbsoluteDifference = -8.188e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0521349130329324e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 9
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.992e-08 median = 1.971e-08 stdev = 3.814e-08
Maximum AbsoluteDifference = 1.060e-07
Minimum AbsoluteDifference = -7.545e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9921176814725556e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 10
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.963e-08 median = 1.957e-08 stdev = 3.840e-08
Maximum AbsoluteDifference = 1.068e-07
Minimum AbsoluteDifference = -8.453e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.963211553475755e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 11
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.002e-08 median = 1.992e-08 stdev = 3.782e-08
Maximum AbsoluteDifference = 1.069e-07
Minimum AbsoluteDifference = -7.795e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0018865129716788e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 14
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.934e-08 median = 1.948e-08 stdev = 3.787e-08
Maximum AbsoluteDifference = 1.065e-07
Minimum AbsoluteDifference = -8.146e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.934278863071435e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 15
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.998e-08 median = 1.972e-08 stdev = 3.778e-08
Maximum AbsoluteDifference = 1.070e-07
Minimum AbsoluteDifference = -8.232e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9978089949593252e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 16
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.930e-08 median = 1.905e-08 stdev = 3.799e-08
Maximum AbsoluteDifference = 1.063e-07
Minimum AbsoluteDifference = -8.209e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9298242536016282e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 17
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.991e-08 median = 2.046e-08 stdev = 3.786e-08
Maximum AbsoluteDifference = 1.076e-07
Minimum AbsoluteDifference = -8.571e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.991328232953174e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 18
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.978e-08 median = 2.033e-08 stdev = 3.756e-08
Maximum AbsoluteDifference = 1.041e-07
Minimum AbsoluteDifference = -8.025e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.978255964214034e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 19
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.985e-08 median = 1.952e-08 stdev = 3.745e-08
Maximum AbsoluteDifference = 1.058e-07
Minimum AbsoluteDifference = -8.176e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.985081709772854e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 21
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.990e-08 median = 1.987e-08 stdev = 3.771e-08
Maximum AbsoluteDifference = 1.081e-07
Minimum AbsoluteDifference = -7.687e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.98972223186782e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 25
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.986e-08 median = 1.951e-08 stdev = 3.801e-08
Maximum AbsoluteDifference = 1.066e-07
Minimum AbsoluteDifference = -8.195e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.985783740278291e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 26
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.982e-08 median = 1.973e-08 stdev = 3.774e-08
Maximum AbsoluteDifference = 1.059e-07
Minimum AbsoluteDifference = -8.156e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.98163772907712e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 27
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.030e-08 median = 2.053e-08 stdev = 3.755e-08
Maximum AbsoluteDifference = 1.082e-07
Minimum AbsoluteDifference = -8.214e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.030077261524953e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 29
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.906e-08 median = 1.872e-08 stdev = 3.784e-08
Maximum AbsoluteDifference = 1.068e-07
Minimum AbsoluteDifference = -8.129e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9062189227472888e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 31
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.952e-08 median = 1.917e-08 stdev = 3.748e-08
Maximum AbsoluteDifference = 1.060e-07
Minimum AbsoluteDifference = -8.219e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9519544633558574e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 32
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.968e-08 median = 1.913e-08 stdev = 3.753e-08
Maximum AbsoluteDifference = 1.086e-07
Minimum AbsoluteDifference = -8.174e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.96754364095182e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 33
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.984e-08 median = 2.034e-08 stdev = 3.766e-08
Maximum AbsoluteDifference = 1.082e-07
Minimum AbsoluteDifference = -8.006e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9836080113672882e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 35
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.950e-08 median = 1.977e-08 stdev = 3.774e-08
Maximum AbsoluteDifference = 1.071e-07
Minimum AbsoluteDifference = -7.921e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9501592362742313e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 37
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.890e-08 median = 1.839e-08 stdev = 3.822e-08
Maximum AbsoluteDifference = 1.060e-07
Minimum AbsoluteDifference = -7.574e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.889764092981036e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 38
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.914e-08 median = 1.910e-08 stdev = 3.746e-08
Maximum AbsoluteDifference = 1.036e-07
Minimum AbsoluteDifference = -8.075e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9139503376481682e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 39
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.009e-08 median = 2.069e-08 stdev = 3.781e-08
Maximum AbsoluteDifference = 1.058e-07
Minimum AbsoluteDifference = -7.473e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0089343742919547e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 41
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.927e-08 median = 1.891e-08 stdev = 3.786e-08
Maximum AbsoluteDifference = 1.075e-07
Minimum AbsoluteDifference = -7.919e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9267388410702878e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 53
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 9.075e-09 median = 9.047e-09 stdev = 3.675e-08
Maximum AbsoluteDifference = 9.116e-08
Minimum AbsoluteDifference = -8.127e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 9.074531857434995e-09 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 54
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 8.244e-09 median = 7.562e-09 stdev = 3.638e-08
Maximum AbsoluteDifference = 9.318e-08
Minimum AbsoluteDifference = -8.118e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 8.243705285694354e-09 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 1
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.944e-08 median = 1.935e-08 stdev = 3.763e-08
Maximum AbsoluteDifference = 1.061e-07
Minimum AbsoluteDifference = -8.421e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9435729822948375e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 2
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.967e-08 median = 1.974e-08 stdev = 3.779e-08
Maximum AbsoluteDifference = 1.064e-07
Minimum AbsoluteDifference = -7.950e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.966893582156562e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 3
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.995e-08 median = 1.941e-08 stdev = 3.760e-08
Maximum AbsoluteDifference = 1.075e-07
Minimum AbsoluteDifference = -8.196e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.994850506776863e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 4
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.024e-08 median = 2.046e-08 stdev = 3.767e-08
Maximum AbsoluteDifference = 1.064e-07
Minimum AbsoluteDifference = -7.875e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0243381544365712e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 5
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.986e-08 median = 1.984e-08 stdev = 3.756e-08
Maximum AbsoluteDifference = 1.059e-07
Minimum AbsoluteDifference = -7.991e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9856563799451523e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 12
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.009e-08 median = 2.048e-08 stdev = 3.710e-08
Maximum AbsoluteDifference = 1.076e-07
Minimum AbsoluteDifference = -8.266e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.008746605945414e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 13
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.010e-08 median = 2.009e-08 stdev = 3.770e-08
Maximum AbsoluteDifference = 1.061e-07
Minimum AbsoluteDifference = -8.021e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0095236664321467e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 20
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.984e-08 median = 1.938e-08 stdev = 3.765e-08
Maximum AbsoluteDifference = 1.062e-07
Minimum AbsoluteDifference = -7.834e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9836037011013375e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 22
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.984e-08 median = 1.917e-08 stdev = 3.745e-08
Maximum AbsoluteDifference = 1.074e-07
Minimum AbsoluteDifference = -8.159e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9844238699991888e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 23
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.000e-08 median = 2.043e-08 stdev = 3.793e-08
Maximum AbsoluteDifference = 1.064e-07
Minimum AbsoluteDifference = -7.818e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0002697259929202e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 24
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.937e-08 median = 1.945e-08 stdev = 3.777e-08
Maximum AbsoluteDifference = 1.049e-07
Minimum AbsoluteDifference = -8.064e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9367450658674414e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 28
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 2.014e-08 median = 2.084e-08 stdev = 3.781e-08
Maximum AbsoluteDifference = 1.071e-07
Minimum AbsoluteDifference = -8.107e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 2.0139794664659006e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 30
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.962e-08 median = 1.988e-08 stdev = 3.777e-08
Maximum AbsoluteDifference = 1.079e-07
Minimum AbsoluteDifference = -8.318e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9616594034707743e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 34
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.953e-08 median = 1.927e-08 stdev = 3.788e-08
Maximum AbsoluteDifference = 1.068e-07
Minimum AbsoluteDifference = -7.986e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.952882817025126e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 36
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.952e-08 median = 1.969e-08 stdev = 3.785e-08
Maximum AbsoluteDifference = 1.070e-07
Minimum AbsoluteDifference = -8.364e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9516680554380267e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 40
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.966e-08 median = 2.010e-08 stdev = 3.808e-08
Maximum AbsoluteDifference = 1.070e-07
Minimum AbsoluteDifference = -8.187e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9656127870990227e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 42
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.937e-08 median = 1.914e-08 stdev = 3.789e-08
Maximum AbsoluteDifference = 1.070e-07
Minimum AbsoluteDifference = -7.914e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9374859687695926e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 43
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.839e-08 median = 1.768e-08 stdev = 3.794e-08
Maximum AbsoluteDifference = 1.083e-07
Minimum AbsoluteDifference = -7.734e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.8391040193240897e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 44
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.993e-08 median = 2.014e-08 stdev = 3.835e-08
Maximum AbsoluteDifference = 1.072e-07
Minimum AbsoluteDifference = -7.819e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.9932060117099157e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 45
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.890e-08 median = 1.917e-08 stdev = 3.794e-08
Maximum AbsoluteDifference = 1.072e-07
Minimum AbsoluteDifference = -7.968e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.8898907421539862e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 46
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.807e-08 median = 1.792e-08 stdev = 3.853e-08
Maximum AbsoluteDifference = 1.049e-07
Minimum AbsoluteDifference = -8.133e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.8071355423986412e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 47
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.764e-08 median = 1.733e-08 stdev = 3.820e-08
Maximum AbsoluteDifference = 1.082e-07
Minimum AbsoluteDifference = -7.683e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.7636796358437654e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 48
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.746e-08 median = 1.745e-08 stdev = 3.829e-08
Maximum AbsoluteDifference = 1.060e-07
Minimum AbsoluteDifference = -8.065e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.7461428378117563e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 49
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.647e-08 median = 1.609e-08 stdev = 3.849e-08
Maximum AbsoluteDifference = 1.074e-07
Minimum AbsoluteDifference = -8.365e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.6468607016015977e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 50
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.641e-08 median = 1.599e-08 stdev = 3.815e-08
Maximum AbsoluteDifference = 1.065e-07
Minimum AbsoluteDifference = -7.869e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.6409063567693312e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 51
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.621e-08 median = 1.610e-08 stdev = 3.804e-08
Maximum AbsoluteDifference = 1.071e-07
Minimum AbsoluteDifference = -8.133e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.621003337025917e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 52
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 1.526e-08 median = 1.532e-08 stdev = 3.805e-08
Maximum AbsoluteDifference = 1.070e-07
Minimum AbsoluteDifference = -7.496e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 1.5264773964734394e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 55
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = 8.904e-10 median = 7.897e-10 stdev = 3.626e-08
Maximum AbsoluteDifference = 7.468e-08
Minimum AbsoluteDifference = -7.879e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = 8.903945605759234e-10 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 56
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = -7.772e-09 median = -7.111e-09 stdev = 3.451e-08
Maximum AbsoluteDifference = 6.467e-08
Minimum AbsoluteDifference = -7.165e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = -7.77219002195146e-09 threshold difference = 9.999e-05
*** Result of the test: PASSED
Working with slitlet 57
Slitlet name in input file and in pathloss output file are the same.
Retrieved extended/uniform source extension 3
slit_x, slit_y (-0.5, -0.5)
Running test for UNIFORM source...
Calculating statistics...
Absolute Difference : mean = -1.194e-08 median = -1.217e-08 stdev = 3.492e-08
Maximum AbsoluteDifference = 5.708e-08
Minimum AbsoluteDifference = -8.314e-08
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
* TEST result: corrections residuals median = -1.1938104016851314e-08 threshold difference = 9.999e-05
*** Result of the test: PASSED
*** Final result for path_loss test will be reported as PASSED ***
('* Script pathloss_mos.py took ', '52.79044771194458 seconds to finish.')
Did pathloss validation test passed? All slits PASSED path_loss test.
Testing files for detector: nrs1
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/ipykernel_1159331/2294938804.py:84: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/.astropy/cache/download/url/8e6d6917d5834a76434dc30e12182a4d/contents' mode='rb' closefd=True> median_diff, result_msg, log_msgs = nptt.calwebb_spec2_pytests.auxiliary_code.pathloss_mos.pathtest(
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_prism_nrs1_uncal.fits
2022-03-24 12:43:40,279 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:43:40,280 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:43:40,281 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:43:40,282 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:43:40,284 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:43:40,284 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:43:40,285 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:43:40,286 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:43:40,287 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:43:40,288 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:43:40,289 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:43:40,290 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:43:40,291 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:43:40,292 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:43:40,293 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:43:40,294 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:43:40,297 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_prism_nrs1_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 12:43:41,829 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_prism_nrs1_uncal.fits',).
2022-03-24 12:43:41,839 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:43:42,024 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_prism_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:43:42,032 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits'.
2022-03-24 12:43:42,035 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits'.
2022-03-24 12:43:42,037 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits'.
2022-03-24 12:43:42,039 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits'.
2022-03-24 12:43:42,040 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:43:42,041 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits'.
2022-03-24 12:43:42,042 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2022-03-24 12:43:42,042 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:43:42,042 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:43:42,042 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits'.
2022-03-24 12:43:42,044 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits'.
2022-03-24 12:43:42,047 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:43:42,047 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:43:42,047 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:43:43,434 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:43:43,436 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:43:43,559 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:43:43,560 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:43:43,562 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:43:44,713 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:43:44,714 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:43:44,735 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0024.fits
2022-03-24 12:43:45,456 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:43:46,604 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:43:46,605 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:43:46,638 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0020.fits
2022-03-24 12:43:47,329 - stpipe.Detector1Pipeline.saturation - INFO - Detected 4320 saturated pixels
2022-03-24 12:43:47,371 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:43:47,384 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:43:48,530 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:43:48,531 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:43:48,532 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:43:48,533 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:43:49,674 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:43:49,675 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:43:49,698 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0087.fits
2022-03-24 12:43:50,253 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:43:51,400 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:43:51,401 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:43:51,411 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2022-03-24 12:43:51,411 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2022-03-24 12:43:51,411 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2022-03-24 12:43:51,412 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.0
2022-03-24 12:43:51,412 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = True
2022-03-24 12:43:55,776 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:43:56,918 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:43:56,919 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:43:56,942 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0018.fits
2022-03-24 12:43:58,474 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:43:59,630 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:43:59,632 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:43:59,653 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0140.fits
2022-03-24 12:44:01,005 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=10, nframes=1, groupgap=0
2022-03-24 12:44:01,005 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2022-03-24 12:44:01,409 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:44:02,577 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:44:02,579 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:44:02,588 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:44:02,601 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-03-24 12:44:02,767 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2022-03-24 12:44:03,172 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:44:03,255 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:44:06,938 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 29968 pixels with at least one CR from five groups.
2022-03-24 12:44:06,939 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 3 pixels with at least one CR from four groups.
2022-03-24 12:44:06,939 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 3 pixels with at least one CR from three groups.
2022-03-24 12:44:11,549 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 8.37611 sec
2022-03-24 12:44:11,552 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 8.964079
2022-03-24 12:44:11,558 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:44:12,724 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:44:12,725 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:44:12,759 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0019.fits
2022-03-24 12:44:12,759 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0019.fits
2022-03-24 12:44:12,870 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:44:12,870 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:44:53,810 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 10
2022-03-24 12:44:53,811 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:44:54,042 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:44:55,268 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:44:55,269 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:44:55,345 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:44:55,345 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:44:55,350 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:44:56,499 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:44:56,501 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:44:56,569 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:44:56,569 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:44:56,573 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:44:56,575 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:44:56,577 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:44:56,587 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 12:44:57,738 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:44:57,739 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-03-24 12:44:57,936 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.03312480077147484 deg
2022-03-24 12:44:57,936 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3411945700645447 deg
2022-03-24 12:44:57,937 - stpipe.AssignWcsStep - INFO - theta_y correction: -0.005294283663966503 deg
2022-03-24 12:44:57,938 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:45:00,604 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_ifu pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0034.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0028.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': '/grp/crds/cache/references/jwst/jwst_nirspec_ifupost_0004.asdf', 'ifufore': '/grp/crds/cache/references/jwst/jwst_nirspec_ifufore_0003.asdf', 'ifuslicer': '/grp/crds/cache/references/jwst/jwst_nirspec_ifuslicer_0003.asdf'}
2022-03-24 12:45:06,179 - stpipe.AssignWcsStep - INFO - Update S_REGION to POLYGON ICRS 156.176998032 -45.687618307 156.178780407 -45.687618307 156.178780407 -45.686330486 156.176998032 -45.686330486
2022-03-24 12:45:06,181 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-03-24 12:45:06,194 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-03-24 12:45:06,204 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-03-24 12:45:07,977 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:45:07,983 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:45:08,003 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-03-24 12:45:08,004 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-03-24 12:45:08,139 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.03312480077147484 deg
2022-03-24 12:45:08,140 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3411945700645447 deg
2022-03-24 12:45:08,140 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -0.005294283663966503 deg
2022-03-24 12:45:08,142 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:45:08,155 - stpipe.MSAFlagOpenStep - INFO - SPORDER= 0, wrange=[6e-07, 5.3e-06]
2022-03-24 12:45:08,304 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-03-24 12:45:08,342 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-03-24 12:45:08,366 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-03-24 12:45:08,436 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-03-24 12:45:08,460 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2585.2572652943927.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2329.91715711254.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2731.341633999907.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2095.6529334650595.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2085.8983001463794.
warnings.warn(f"Invalid interval: upper bound {upper} "
2022-03-24 12:45:23,874 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-03-24 12:45:23,886 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2022-03-24 12:45:25,345 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:45:25,350 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:45:25,359 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_IFU
2022-03-24 12:45:25,360 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2022-03-24 12:45:25,360 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = EXTENDED
2022-03-24 12:45:25,363 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2022-03-24 12:45:25,373 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2022-03-24 12:45:26,309 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:45:26,310 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:45:26,319 - stpipe.WavecorrStep - INFO - Skipping wavecorr correction for EXP_TYPE NRS_IFU
2022-03-24 12:45:26,321 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2022-03-24 12:45:26,332 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2022-03-24 12:45:27,284 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:45:27,285 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-03-24 12:48:21,435 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
2022-03-24 12:48:21,448 - stpipe.PathLossStep - INFO - PathLossStep instance created.
2022-03-24 12:48:23,902 - stpipe.PathLossStep - INFO - Step PathLossStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs1_uncal.fits>,).
2022-03-24 12:48:23,909 - stpipe.PathLossStep - INFO - Step PathLossStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-03-24 12:48:23,933 - stpipe.PathLossStep - INFO - Using PATHLOSS reference file /grp/crds/cache/references/jwst/jwst_nirspec_pathloss_0003.fits
2022-03-24 12:48:23,970 - stpipe.PathLossStep - INFO - Input exposure type is NRS_IFU
2022-03-24 12:49:34,382 - stpipe.PathLossStep - INFO - Step PathLossStep done
Running test for IFU... Checking if files exist and obtaining datamodels. This takes a few minutes... from datamodel --> Detector: NRS1 Grating: PRISM Filter: CLEAR Lamp: NO_LAMP EXP_TYPE: NRS_IFU Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0003.fits got input slices PLCOR_REF.shape (21, 21, 21) Looping through the slices... working with slice 0 SHAPES (40, 439) (39, 438) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 780, right 819, top 999, bottom 561 NEW SHAPE OF SLICE: (39, 438) and corr_vals.shape: (39, 438)
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/pathloss_ifu_uni.py:168: RuntimeWarning: invalid value encountered in true_divide pathloss_divided = comp_sci/previous_sci
working with slice 1 SHAPES (41, 441) (40, 442) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1197, right 1237, top 946, bottom 504 NEW SHAPE OF SLICE: (40, 442) and corr_vals.shape: (40, 442)
working with slice 2 SHAPES (40, 438) (39, 438) ALTERED SHAPE OF SLICE: V2 final left 730, right 769, top 1005, bottom 567 NEW SHAPE OF SLICE: (39, 438) and corr_vals.shape: (39, 438)
working with slice 3 SHAPES (41, 442) (40, 442) ALTERED SHAPE OF SLICE: V2 final left 1246, right 1286, top 940, bottom 498 NEW SHAPE OF SLICE: (40, 442) and corr_vals.shape: (40, 442)
working with slice 4 SHAPES (40, 437) (39, 438) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 681, right 720, top 1010, bottom 572 NEW SHAPE OF SLICE: (39, 438) and corr_vals.shape: (39, 438)
working with slice 5 SHAPES (41, 442) (40, 442) ALTERED SHAPE OF SLICE: V2 final left 1295, right 1335, top 933, bottom 491 NEW SHAPE OF SLICE: (40, 442) and corr_vals.shape: (40, 442)
working with slice 6 SHAPES (40, 437) (39, 438) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 632, right 671, top 1016, bottom 578 NEW SHAPE OF SLICE: (39, 438) and corr_vals.shape: (39, 438)
working with slice 7 SHAPES (40, 443) (39, 443) ALTERED SHAPE OF SLICE: V2 final left 1345, right 1384, top 926, bottom 483 NEW SHAPE OF SLICE: (39, 443) and corr_vals.shape: (39, 443)
working with slice 8 SHAPES (40, 437) (39, 437) ALTERED SHAPE OF SLICE: V2 final left 582, right 621, top 1022, bottom 585 NEW SHAPE OF SLICE: (39, 437) and corr_vals.shape: (39, 437)
working with slice 9 SHAPES (41, 443) (40, 443) ALTERED SHAPE OF SLICE: V2 final left 1394, right 1434, top 919, bottom 476 NEW SHAPE OF SLICE: (40, 443) and corr_vals.shape: (40, 443)
working with slice 10 SHAPES (40, 436) (39, 437) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 533, right 572, top 1027, bottom 590 NEW SHAPE OF SLICE: (39, 437) and corr_vals.shape: (39, 437)
working with slice 11 SHAPES (41, 443) (40, 444) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1443, right 1483, top 912, bottom 468 NEW SHAPE OF SLICE: (40, 444) and corr_vals.shape: (40, 444)
working with slice 12 SHAPES (40, 437) (39, 436) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 484, right 523, top 1033, bottom 597 NEW SHAPE OF SLICE: (39, 436) and corr_vals.shape: (39, 436)
working with slice 13 SHAPES (41, 443) (40, 444) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1492, right 1532, top 905, bottom 461 NEW SHAPE OF SLICE: (40, 444) and corr_vals.shape: (40, 444)
working with slice 14 SHAPES (40, 436) (39, 436) ALTERED SHAPE OF SLICE: V2 final left 434, right 473, top 1038, bottom 602 NEW SHAPE OF SLICE: (39, 436) and corr_vals.shape: (39, 436)
working with slice 15 SHAPES (41, 444) (40, 444) ALTERED SHAPE OF SLICE: V2 final left 1541, right 1581, top 898, bottom 454 NEW SHAPE OF SLICE: (40, 444) and corr_vals.shape: (40, 444)
working with slice 16 SHAPES (40, 436) (39, 436) ALTERED SHAPE OF SLICE: V2 final left 385, right 424, top 1044, bottom 608 NEW SHAPE OF SLICE: (39, 436) and corr_vals.shape: (39, 436)
working with slice 17 SHAPES (41, 444) (40, 445) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1590, right 1630, top 891, bottom 446 NEW SHAPE OF SLICE: (40, 445) and corr_vals.shape: (40, 445)
working with slice 18 SHAPES (40, 436) (39, 435) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 336, right 375, top 1049, bottom 614 NEW SHAPE OF SLICE: (39, 435) and corr_vals.shape: (39, 435)
working with slice 19 SHAPES (41, 445) (40, 445) ALTERED SHAPE OF SLICE: V2 final left 1639, right 1679, top 884, bottom 439 NEW SHAPE OF SLICE: (40, 445) and corr_vals.shape: (40, 445)
working with slice 20 SHAPES (40, 435) (39, 436) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 286, right 325, top 1054, bottom 618 NEW SHAPE OF SLICE: (39, 436) and corr_vals.shape: (39, 436)
working with slice 21 SHAPES (41, 446) (40, 445) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 1688, right 1728, top 877, bottom 432 NEW SHAPE OF SLICE: (40, 445) and corr_vals.shape: (40, 445)
working with slice 22 SHAPES (40, 435) (39, 435) ALTERED SHAPE OF SLICE: V2 final left 237, right 276, top 1059, bottom 624 NEW SHAPE OF SLICE: (39, 435) and corr_vals.shape: (39, 435)
working with slice 23 SHAPES (41, 446) (40, 446) ALTERED SHAPE OF SLICE: V2 final left 1737, right 1777, top 870, bottom 424 NEW SHAPE OF SLICE: (40, 446) and corr_vals.shape: (40, 446)
working with slice 24 SHAPES (40, 435) (39, 435) ALTERED SHAPE OF SLICE: V2 final left 187, right 226, top 1064, bottom 629 NEW SHAPE OF SLICE: (39, 435) and corr_vals.shape: (39, 435)
working with slice 25 SHAPES (42, 446) (41, 447) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1785, right 1826, top 862, bottom 415 NEW SHAPE OF SLICE: (41, 447) and corr_vals.shape: (41, 447)
working with slice 26 SHAPES (40, 435) (39, 435) ALTERED SHAPE OF SLICE: V2 final left 138, right 177, top 1069, bottom 634 NEW SHAPE OF SLICE: (39, 435) and corr_vals.shape: (39, 435)
working with slice 27 SHAPES (42, 447) (41, 447) ALTERED SHAPE OF SLICE: V2 final left 1834, right 1875, top 855, bottom 408 NEW SHAPE OF SLICE: (41, 447) and corr_vals.shape: (41, 447)
working with slice 28 SHAPES (40, 434) (39, 435) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 88, right 127, top 1074, bottom 639 NEW SHAPE OF SLICE: (39, 435) and corr_vals.shape: (39, 435)
working with slice 29 SHAPES (42, 447) (41, 447) ALTERED SHAPE OF SLICE: V2 final left 1883, right 1924, top 847, bottom 400 NEW SHAPE OF SLICE: (41, 447) and corr_vals.shape: (41, 447)
Calculating statistics...
Absolute Difference : mean = 0.000e+00 median = 0.000e+00 stdev = 0.000e+00
Maximum AbsoluteDifference = 0.000e+00
Minimum AbsoluteDifference = 0.000e+00
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
*** Final result of pathloss test is PASSED ***
('* Script ifu_uni.py took ', '1.4617333928743999 minutes to finish.')
Did pathloss validation test passed? All slits PASSED path_loss test.
Testing files for detector: nrs2
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_prism_nrs2_uncal.fits
2022-03-24 12:51:03,051 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:51:03,052 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:51:03,053 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:51:03,054 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:51:03,055 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:51:03,056 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:51:03,058 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:51:03,059 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:51:03,060 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:51:03,061 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:51:03,062 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:51:03,063 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:51:03,064 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:51:03,065 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:51:03,066 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:51:03,069 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:51:03,070 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_prism_nrs2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 12:51:04,216 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_prism_nrs2_uncal.fits',).
2022-03-24 12:51:04,229 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:51:04,408 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_prism_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:51:04,414 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits'.
2022-03-24 12:51:04,416 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits'.
2022-03-24 12:51:04,418 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits'.
2022-03-24 12:51:04,419 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits'.
2022-03-24 12:51:04,420 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:51:04,421 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits'.
2022-03-24 12:51:04,422 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is 'N/A'.
2022-03-24 12:51:04,422 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:51:04,422 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:51:04,423 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits'.
2022-03-24 12:51:04,424 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits'.
2022-03-24 12:51:04,425 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:51:04,426 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:51:04,426 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:51:05,141 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:51:05,142 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:51:05,270 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:51:05,270 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:51:05,272 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:51:05,752 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:51:05,754 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:51:05,774 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0025.fits
2022-03-24 12:51:06,586 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:51:07,066 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:51:07,068 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:51:07,088 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0021.fits
2022-03-24 12:51:07,996 - stpipe.Detector1Pipeline.saturation - INFO - Detected 2388 saturated pixels
2022-03-24 12:51:08,037 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:51:08,050 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:51:08,540 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:51:08,542 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:51:08,542 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:51:08,544 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:51:09,030 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:51:09,031 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:51:09,055 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0104.fits
2022-03-24 12:51:09,624 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:51:10,113 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:51:10,115 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:51:10,124 - stpipe.Detector1Pipeline.refpix - INFO - use_side_ref_pixels = True
2022-03-24 12:51:10,125 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_columns = True
2022-03-24 12:51:10,125 - stpipe.Detector1Pipeline.refpix - INFO - side_smoothing_length = 11
2022-03-24 12:51:10,126 - stpipe.Detector1Pipeline.refpix - INFO - side_gain = 1.0
2022-03-24 12:51:10,126 - stpipe.Detector1Pipeline.refpix - INFO - odd_even_rows = True
2022-03-24 12:51:14,634 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:51:15,120 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:51:15,122 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:51:15,144 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0021.fits
2022-03-24 12:51:19,179 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:51:19,660 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:51:19,662 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:51:19,684 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0143.fits
2022-03-24 12:51:23,890 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=10, nframes=1, groupgap=0
2022-03-24 12:51:23,891 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=10, nframes=1, groupgap=0
2022-03-24 12:51:24,319 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:51:24,804 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:51:24,806 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:51:24,815 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:51:24,828 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-03-24 12:51:25,001 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2022-03-24 12:51:25,390 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:51:25,473 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:51:29,108 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 13801 pixels with at least one CR from five groups.
2022-03-24 12:51:29,109 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from four groups.
2022-03-24 12:51:29,109 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 0 pixels with at least one CR from three groups.
2022-03-24 12:51:31,751 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 6.36012 sec
2022-03-24 12:51:31,755 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 6.939306
2022-03-24 12:51:31,760 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:51:32,243 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 10, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:51:32,244 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:51:32,277 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0016.fits
2022-03-24 12:51:32,278 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0018.fits
2022-03-24 12:51:32,386 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:51:32,387 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:52:11,706 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 10
2022-03-24 12:52:11,707 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:52:11,927 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:52:12,452 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:52:12,454 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:52:12,529 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:52:12,529 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:52:12,533 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:52:13,015 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:52:13,016 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:52:13,088 - stpipe.Detector1Pipeline.gain_scale - INFO - GAINFACT not found in gain reference file
2022-03-24 12:52:13,089 - stpipe.Detector1Pipeline.gain_scale - INFO - Step will be skipped
2022-03-24 12:52:13,093 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:52:13,095 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:52:13,097 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:52:13,108 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 12:52:13,615 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_prism_nrs2_uncal.fits>,).
2022-03-24 12:52:13,616 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-03-24 12:52:13,772 - stpipe.AssignWcsStep - CRITICAL - No IFU slices fall on detector NRS2
An error occurred that made the pipeline crash, probably: No open slits fall on detector nrs2 Skipping test for this file. Did pathloss validation test passed? skipped Testing files for detector: nrs1 Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_g395h_f290lp_nrs1_uncal.fits
2022-03-24 12:52:15,758 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 12:52:15,759 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 12:52:15,761 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 12:52:15,762 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 12:52:15,763 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 12:52:15,764 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 12:52:15,765 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 12:52:15,766 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 12:52:15,767 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 12:52:15,768 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 12:52:15,769 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 12:52:15,770 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 12:52:15,771 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 12:52:15,772 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 12:52:15,773 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 12:52:15,774 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 12:52:15,775 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_g395h_f290lp_nrs1_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 12:52:16,253 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_g395h_f290lp_nrs1_uncal.fits',).
2022-03-24 12:52:16,262 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 12:52:16,545 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_g395h_f290lp_nrs1_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 12:52:16,552 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0088.fits'.
2022-03-24 12:52:16,554 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0023.fits'.
2022-03-24 12:52:16,555 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0022.fits'.
2022-03-24 12:52:16,556 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits'.
2022-03-24 12:52:16,557 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 12:52:16,558 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits'.
2022-03-24 12:52:16,559 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0019.fits'.
2022-03-24 12:52:16,560 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 12:52:16,561 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 12:52:16,561 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0027.fits'.
2022-03-24 12:52:16,562 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0117.fits'.
2022-03-24 12:52:16,564 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 12:52:16,564 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 12:52:16,564 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 12:52:17,633 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:52:17,634 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:52:18,015 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 12:52:18,015 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 12:52:18,017 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 12:52:18,489 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:52:18,491 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:52:18,513 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0010.fits
2022-03-24 12:52:19,465 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 12:52:19,946 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:52:19,947 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:52:19,968 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0027.fits
2022-03-24 12:52:23,569 - stpipe.Detector1Pipeline.saturation - INFO - Detected 131958 saturated pixels
2022-03-24 12:52:23,771 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 12:52:23,803 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 12:52:24,782 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:52:24,784 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:52:24,784 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 12:52:24,787 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 12:52:25,455 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:52:25,457 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:52:25,481 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0117.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-03-24 12:52:26,850 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 12:52:27,337 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:52:27,338 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 12:52:27,359 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0019.fits
2022-03-24 12:52:28,066 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-03-24 12:53:37,501 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 12:53:38,098 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:53:38,099 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:53:38,126 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0022.fits
2022-03-24 12:53:39,790 - stpipe.Detector1Pipeline.linearity - WARNING - Keyword BAD_LIN_CORR does not correspond to an existing DQ mnemonic, so will be ignored
2022-03-24 12:53:41,525 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 12:53:42,028 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:53:42,030 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 12:53:42,288 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0088.fits
2022-03-24 12:54:15,661 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=20, nframes=1, groupgap=0
2022-03-24 12:54:15,662 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-03-24 12:54:17,260 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 12:54:17,785 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:54:17,787 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 12:54:17,910 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 12:54:18,105 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0023.fits
2022-03-24 12:54:18,704 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-03-24 12:54:19,768 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 12:54:19,969 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 12:54:28,786 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 81026 pixels with at least one CR from five groups.
2022-03-24 12:54:28,787 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 426 pixels with at least one CR from four groups.
2022-03-24 12:54:28,787 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 483 pixels with at least one CR from three groups.
2022-03-24 12:55:03,744 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 43.9749 sec
2022-03-24 12:55:03,747 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 45.836625
2022-03-24 12:55:03,752 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 12:55:04,255 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:55:04,257 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 12:55:04,618 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0018.fits
2022-03-24 12:55:04,619 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0023.fits
2022-03-24 12:55:04,707 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 12:55:04,707 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 12:57:35,809 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 20
2022-03-24 12:57:35,810 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 12:57:35,981 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 12:57:36,523 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:57:36,525 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:57:36,582 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2022-03-24 12:57:36,599 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:57:37,081 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:57:37,082 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 12:57:37,142 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2022-03-24 12:57:37,159 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 12:57:37,160 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 12:57:37,162 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 12:57:37,173 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 12:57:37,659 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:57:37,661 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-03-24 12:57:37,859 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-03-24 12:57:37,860 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-03-24 12:57:37,860 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-03-24 12:57:37,861 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:57:41,078 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_ifu pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': '/grp/crds/cache/references/jwst/jwst_nirspec_ifupost_0004.asdf', 'ifufore': '/grp/crds/cache/references/jwst/jwst_nirspec_ifufore_0003.asdf', 'ifuslicer': '/grp/crds/cache/references/jwst/jwst_nirspec_ifuslicer_0003.asdf'}
2022-03-24 12:57:48,420 - stpipe.AssignWcsStep - INFO - Update S_REGION to POLYGON ICRS 156.176999392 -45.687618156 156.178775679 -45.687618156 156.178775679 -45.686331563 156.176999392 -45.686331563
2022-03-24 12:57:48,422 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-03-24 12:57:48,434 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-03-24 12:57:48,445 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-03-24 12:57:49,321 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:57:49,325 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:57:49,346 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-03-24 12:57:49,347 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-03-24 12:57:49,531 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-03-24 12:57:49,532 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-03-24 12:57:49,532 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-03-24 12:57:49,533 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-03-24 12:57:49,546 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2022-03-24 12:57:49,722 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-03-24 12:57:49,766 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-03-24 12:57:49,792 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-03-24 12:57:49,866 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-03-24 12:57:49,891 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2525.1239286219193.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2239.8443211081017.
warnings.warn(f"Invalid interval: upper bound {upper} "
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/astropy/modeling/bounding_box.py:85: RuntimeWarning: Invalid interval: upper bound 2047.5 is strictly less than lower bound 2382.5735098584228.
warnings.warn(f"Invalid interval: upper bound {upper} "
2022-03-24 12:58:05,296 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-03-24 12:58:05,314 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2022-03-24 12:58:06,264 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:58:06,268 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:58:06,277 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_IFU
2022-03-24 12:58:06,278 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2022-03-24 12:58:06,278 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = EXTENDED
2022-03-24 12:58:06,281 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2022-03-24 12:58:06,291 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2022-03-24 12:58:06,818 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:58:06,819 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 12:58:06,828 - stpipe.WavecorrStep - INFO - Skipping wavecorr correction for EXP_TYPE NRS_IFU
2022-03-24 12:58:06,830 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2022-03-24 12:58:06,840 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2022-03-24 12:58:07,365 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 12:58:07,366 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-03-24 13:06:02,128 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
2022-03-24 13:06:02,141 - stpipe.PathLossStep - INFO - PathLossStep instance created.
2022-03-24 13:06:03,710 - stpipe.PathLossStep - INFO - Step PathLossStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs1_uncal.fits>,).
2022-03-24 13:06:03,716 - stpipe.PathLossStep - INFO - Step PathLossStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-03-24 13:06:03,742 - stpipe.PathLossStep - INFO - Using PATHLOSS reference file /grp/crds/cache/references/jwst/jwst_nirspec_pathloss_0003.fits
2022-03-24 13:06:03,776 - stpipe.PathLossStep - INFO - Input exposure type is NRS_IFU
2022-03-24 13:07:15,455 - stpipe.PathLossStep - INFO - Step PathLossStep done
Running test for IFU... Checking if files exist and obtaining datamodels. This takes a few minutes... from datamodel --> Detector: NRS1 Grating: G395H Filter: F290LP Lamp: REF EXP_TYPE: NRS_IFU Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0003.fits got input slices PLCOR_REF.shape (21, 21, 21) Looping through the slices... working with slice 0 SHAPES (50, 1775) (49, 1774) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 781, right 830, top 2048, bottom 274 NEW SHAPE OF SLICE: (49, 1774) and corr_vals.shape: (49, 1774)
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/pathloss_ifu_uni.py:168: RuntimeWarning: invalid value encountered in true_divide pathloss_divided = comp_sci/previous_sci
working with slice 1 SHAPES (52, 1737) (51, 1737) ALTERED SHAPE OF SLICE: V2 final left 1197, right 1248, top 2048, bottom 311 NEW SHAPE OF SLICE: (51, 1737) and corr_vals.shape: (51, 1737)
working with slice 2 SHAPES (51, 1779) (50, 1778) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 731, right 781, top 2048, bottom 270 NEW SHAPE OF SLICE: (50, 1778) and corr_vals.shape: (50, 1778)
working with slice 3 SHAPES (52, 1733) (51, 1732) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 1246, right 1297, top 2048, bottom 316 NEW SHAPE OF SLICE: (51, 1732) and corr_vals.shape: (51, 1732)
working with slice 4 SHAPES (51, 1783) (50, 1783) ALTERED SHAPE OF SLICE: V2 final left 682, right 732, top 2048, bottom 265 NEW SHAPE OF SLICE: (50, 1783) and corr_vals.shape: (50, 1783)
working with slice 5 SHAPES (51, 1728) (50, 1728) ALTERED SHAPE OF SLICE: V2 final left 1296, right 1346, top 2048, bottom 320 NEW SHAPE OF SLICE: (50, 1728) and corr_vals.shape: (50, 1728)
working with slice 6 SHAPES (50, 1787) (49, 1787) ALTERED SHAPE OF SLICE: V2 final left 633, right 682, top 2048, bottom 261 NEW SHAPE OF SLICE: (49, 1787) and corr_vals.shape: (49, 1787)
working with slice 7 SHAPES (51, 1723) (50, 1723) ALTERED SHAPE OF SLICE: V2 final left 1345, right 1395, top 2048, bottom 325 NEW SHAPE OF SLICE: (50, 1723) and corr_vals.shape: (50, 1723)
working with slice 8 SHAPES (50, 1791) (49, 1791) ALTERED SHAPE OF SLICE: V2 final left 584, right 633, top 2048, bottom 257 NEW SHAPE OF SLICE: (49, 1791) and corr_vals.shape: (49, 1791)
working with slice 9 SHAPES (51, 1719) (50, 1718) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 1394, right 1444, top 2048, bottom 330 NEW SHAPE OF SLICE: (50, 1718) and corr_vals.shape: (50, 1718)
working with slice 10 SHAPES (51, 1795) (50, 1795) ALTERED SHAPE OF SLICE: V2 final left 534, right 584, top 2048, bottom 253 NEW SHAPE OF SLICE: (50, 1795) and corr_vals.shape: (50, 1795)
working with slice 11 SHAPES (52, 1714) (51, 1713) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 1442, right 1493, top 2048, bottom 335 NEW SHAPE OF SLICE: (51, 1713) and corr_vals.shape: (51, 1713)
working with slice 12 SHAPES (51, 1799) (50, 1799) ALTERED SHAPE OF SLICE: V2 final left 485, right 535, top 2048, bottom 249 NEW SHAPE OF SLICE: (50, 1799) and corr_vals.shape: (50, 1799)
working with slice 13 SHAPES (52, 1709) (51, 1709) ALTERED SHAPE OF SLICE: V2 final left 1491, right 1542, top 2048, bottom 339 NEW SHAPE OF SLICE: (51, 1709) and corr_vals.shape: (51, 1709)
working with slice 14 SHAPES (50, 1803) (49, 1803) ALTERED SHAPE OF SLICE: V2 final left 436, right 485, top 2048, bottom 245 NEW SHAPE OF SLICE: (49, 1803) and corr_vals.shape: (49, 1803)
working with slice 15 SHAPES (52, 1704) (51, 1704) ALTERED SHAPE OF SLICE: V2 final left 1540, right 1591, top 2048, bottom 344 NEW SHAPE OF SLICE: (51, 1704) and corr_vals.shape: (51, 1704)
working with slice 16 SHAPES (50, 1807) (49, 1807) ALTERED SHAPE OF SLICE: V2 final left 387, right 436, top 2048, bottom 241 NEW SHAPE OF SLICE: (49, 1807) and corr_vals.shape: (49, 1807)
working with slice 17 SHAPES (52, 1699) (51, 1699) ALTERED SHAPE OF SLICE: V2 final left 1589, right 1640, top 2048, bottom 349 NEW SHAPE OF SLICE: (51, 1699) and corr_vals.shape: (51, 1699)
working with slice 18 SHAPES (51, 1811) (50, 1811) ALTERED SHAPE OF SLICE: V2 final left 337, right 387, top 2048, bottom 237 NEW SHAPE OF SLICE: (50, 1811) and corr_vals.shape: (50, 1811)
working with slice 19 SHAPES (52, 1695) (51, 1694) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 1638, right 1689, top 2048, bottom 354 NEW SHAPE OF SLICE: (51, 1694) and corr_vals.shape: (51, 1694)
working with slice 20 SHAPES (50, 1815) (49, 1814) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 288, right 337, top 2048, bottom 234 NEW SHAPE OF SLICE: (49, 1814) and corr_vals.shape: (49, 1814)
working with slice 21 SHAPES (52, 1690) (51, 1689) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 1687, right 1738, top 2048, bottom 359 NEW SHAPE OF SLICE: (51, 1689) and corr_vals.shape: (51, 1689)
working with slice 22 SHAPES (51, 1819) (50, 1818) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 238, right 288, top 2048, bottom 230 NEW SHAPE OF SLICE: (50, 1818) and corr_vals.shape: (50, 1818)
working with slice 23 SHAPES (52, 1685) (51, 1684) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 1736, right 1787, top 2048, bottom 364 NEW SHAPE OF SLICE: (51, 1684) and corr_vals.shape: (51, 1684)
working with slice 24 SHAPES (51, 1823) (50, 1822) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 189, right 239, top 2048, bottom 226 NEW SHAPE OF SLICE: (50, 1822) and corr_vals.shape: (50, 1822)
working with slice 25 SHAPES (53, 1680) (52, 1679) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 1784, right 1836, top 2048, bottom 369 NEW SHAPE OF SLICE: (52, 1679) and corr_vals.shape: (52, 1679)
working with slice 26 SHAPES (50, 1826) (49, 1826) ALTERED SHAPE OF SLICE: V2 final left 140, right 189, top 2048, bottom 222 NEW SHAPE OF SLICE: (49, 1826) and corr_vals.shape: (49, 1826)
working with slice 27 SHAPES (53, 1675) (52, 1674) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V6 final left 1833, right 1885, top 2048, bottom 374 NEW SHAPE OF SLICE: (52, 1674) and corr_vals.shape: (52, 1674)
working with slice 28 SHAPES (50, 1830) (49, 1830) ALTERED SHAPE OF SLICE: V2 final left 90, right 139, top 2048, bottom 218 NEW SHAPE OF SLICE: (49, 1830) and corr_vals.shape: (49, 1830)
working with slice 29 SHAPES (52, 1669) (51, 1669) ALTERED SHAPE OF SLICE: V2 final left 1882, right 1933, top 2048, bottom 379 NEW SHAPE OF SLICE: (51, 1669) and corr_vals.shape: (51, 1669)
Calculating statistics...
Absolute Difference : mean = 0.000e+00 median = 0.000e+00 stdev = 0.000e+00
Maximum AbsoluteDifference = 0.000e+00
Minimum AbsoluteDifference = 0.000e+00
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
*** Final result of pathloss test is PASSED ***
('* Script ifu_uni.py took ', '1.4373588641484578 minutes to finish.')
Did pathloss validation test passed? All slits PASSED path_loss test.
Testing files for detector: nrs2
Working with uncal_file: /internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_g395h_f290lp_nrs2_uncal.fits
2022-03-24 13:08:43,747 - stpipe.Detector1Pipeline - INFO - Detector1Pipeline instance created.
2022-03-24 13:08:43,749 - stpipe.Detector1Pipeline.group_scale - INFO - GroupScaleStep instance created.
2022-03-24 13:08:43,750 - stpipe.Detector1Pipeline.dq_init - INFO - DQInitStep instance created.
2022-03-24 13:08:43,751 - stpipe.Detector1Pipeline.saturation - INFO - SaturationStep instance created.
2022-03-24 13:08:43,752 - stpipe.Detector1Pipeline.ipc - INFO - IPCStep instance created.
2022-03-24 13:08:43,753 - stpipe.Detector1Pipeline.superbias - INFO - SuperBiasStep instance created.
2022-03-24 13:08:43,754 - stpipe.Detector1Pipeline.refpix - INFO - RefPixStep instance created.
2022-03-24 13:08:43,755 - stpipe.Detector1Pipeline.rscd - INFO - RscdStep instance created.
2022-03-24 13:08:43,756 - stpipe.Detector1Pipeline.firstframe - INFO - FirstFrameStep instance created.
2022-03-24 13:08:43,757 - stpipe.Detector1Pipeline.lastframe - INFO - LastFrameStep instance created.
2022-03-24 13:08:43,759 - stpipe.Detector1Pipeline.linearity - INFO - LinearityStep instance created.
2022-03-24 13:08:43,760 - stpipe.Detector1Pipeline.dark_current - INFO - DarkCurrentStep instance created.
2022-03-24 13:08:43,761 - stpipe.Detector1Pipeline.reset - INFO - ResetStep instance created.
2022-03-24 13:08:43,762 - stpipe.Detector1Pipeline.persistence - INFO - PersistenceStep instance created.
2022-03-24 13:08:43,763 - stpipe.Detector1Pipeline.jump - INFO - JumpStep instance created.
2022-03-24 13:08:43,764 - stpipe.Detector1Pipeline.ramp_fit - INFO - RampFitStep instance created.
2022-03-24 13:08:43,768 - stpipe.Detector1Pipeline.gain_scale - INFO - GainScaleStep instance created.
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stpipe/step.py:379: ResourceWarning: unclosed file <_io.FileIO name='/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_g395h_f290lp_nrs2_uncal.fits' mode='rb' closefd=True>
gc.collect()
2022-03-24 13:08:46,269 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline running with args ('/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2/ifu_g395h_f290lp_nrs2_uncal.fits',).
2022-03-24 13:08:46,284 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_calibrated_ramp': False, 'steps': {'group_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dq_init': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'saturation': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'ipc': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'superbias': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'refpix': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}, 'rscd': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'type': 'baseline'}, 'firstframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'lastframe': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'linearity': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'dark_current': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'dark_output': None}, 'reset': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}, 'persistence': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'input_trapsfilled': '', 'flag_pers_cutoff': 40.0, 'save_persistence': False, 'save_trapsfilled': True}, 'jump': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}, 'ramp_fit': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}, 'gain_scale': {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}}}
2022-03-24 13:08:46,625 - stpipe.Detector1Pipeline - INFO - Prefetching reference files for dataset: 'ifu_g395h_f290lp_nrs2_uncal.fits' reftypes = ['dark', 'gain', 'linearity', 'mask', 'persat', 'readnoise', 'refpix', 'reset', 'rscd', 'saturation', 'superbias', 'trapdensity', 'trappars']
2022-03-24 13:08:46,634 - stpipe.Detector1Pipeline - INFO - Prefetch for DARK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_dark_0085.fits'.
2022-03-24 13:08:46,636 - stpipe.Detector1Pipeline - INFO - Prefetch for GAIN reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_gain_0020.fits'.
2022-03-24 13:08:46,637 - stpipe.Detector1Pipeline - INFO - Prefetch for LINEARITY reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_linearity_0025.fits'.
2022-03-24 13:08:46,638 - stpipe.Detector1Pipeline - INFO - Prefetch for MASK reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits'.
2022-03-24 13:08:46,640 - stpipe.Detector1Pipeline - INFO - Prefetch for PERSAT reference file is 'N/A'.
2022-03-24 13:08:46,640 - stpipe.Detector1Pipeline - INFO - Prefetch for READNOISE reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits'.
2022-03-24 13:08:46,642 - stpipe.Detector1Pipeline - INFO - Prefetch for REFPIX reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_refpix_0018.fits'.
2022-03-24 13:08:46,643 - stpipe.Detector1Pipeline - INFO - Prefetch for RESET reference file is 'N/A'.
2022-03-24 13:08:46,643 - stpipe.Detector1Pipeline - INFO - Prefetch for RSCD reference file is 'N/A'.
2022-03-24 13:08:46,643 - stpipe.Detector1Pipeline - INFO - Prefetch for SATURATION reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_saturation_0026.fits'.
2022-03-24 13:08:46,645 - stpipe.Detector1Pipeline - INFO - Prefetch for SUPERBIAS reference file is '/grp/crds/cache/references/jwst/jwst_nirspec_superbias_0118.fits'.
2022-03-24 13:08:46,646 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPDENSITY reference file is 'N/A'.
2022-03-24 13:08:46,647 - stpipe.Detector1Pipeline - INFO - Prefetch for TRAPPARS reference file is 'N/A'.
2022-03-24 13:08:46,647 - stpipe.Detector1Pipeline - INFO - Starting calwebb_detector1 ...
2022-03-24 13:08:48,336 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:08:48,338 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 13:08:48,852 - stpipe.Detector1Pipeline.group_scale - INFO - NFRAMES and FRMDIVSR are equal; correction not needed
2022-03-24 13:08:48,853 - stpipe.Detector1Pipeline.group_scale - INFO - Step will be skipped
2022-03-24 13:08:48,857 - stpipe.Detector1Pipeline.group_scale - INFO - Step group_scale done
2022-03-24 13:08:49,857 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:08:49,859 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 13:08:49,884 - stpipe.Detector1Pipeline.dq_init - INFO - Using MASK reference file /grp/crds/cache/references/jwst/jwst_nirspec_mask_0011.fits
2022-03-24 13:08:50,798 - stpipe.Detector1Pipeline.dq_init - INFO - Step dq_init done
2022-03-24 13:08:51,788 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:08:51,790 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 13:08:51,813 - stpipe.Detector1Pipeline.saturation - INFO - Using SATURATION reference file /grp/crds/cache/references/jwst/jwst_nirspec_saturation_0026.fits
2022-03-24 13:08:55,644 - stpipe.Detector1Pipeline.saturation - INFO - Detected 151502 saturated pixels
2022-03-24 13:08:55,804 - stpipe.Detector1Pipeline.saturation - INFO - Detected 0 A/D floor pixels
2022-03-24 13:08:55,838 - stpipe.Detector1Pipeline.saturation - INFO - Step saturation done
2022-03-24 13:08:56,874 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:08:56,876 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': True, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 13:08:56,876 - stpipe.Detector1Pipeline.ipc - INFO - Step skipped.
2022-03-24 13:08:56,879 - stpipe.Detector1Pipeline.ipc - INFO - Step ipc done
2022-03-24 13:08:57,861 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:08:57,863 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 13:08:57,890 - stpipe.Detector1Pipeline.superbias - INFO - Using SUPERBIAS reference file /grp/crds/cache/references/jwst/jwst_nirspec_superbias_0118.fits
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stdatamodels/validate.py:38: ValidationWarning: While validating meta.exposure.readpatt the following error occurred:
'ALLIRS2' is not one of ['ACQ1', 'ACQ2', 'BRIGHT1', 'BRIGHT2', 'DEEP2', 'DEEP8', 'FAST', 'FASTGRPAVG', 'FASTGRPAVG8', 'FASTGRPAVG16', 'FASTGRPAVG32', 'FASTGRPAVG64', 'FASTR1', 'FASTR100', 'FGS', 'FGS60', 'FGS8370', 'FGS840', 'FGSRAPID', 'FINEGUIDE', 'ID', 'MEDIUM2', 'MEDIUM8', 'NIS', 'NISRAPID', 'NRS', 'NRSIRS2', 'NRSN16R4', 'NRSN32R8', 'NRSN8R2', 'NRSRAPID', 'NRSIRS2RAPID', 'NRSRAPIDD1', 'NRSRAPIDD2', 'NRSRAPIDD6', 'NRSSLOW', 'RAPID', 'SHALLOW2', 'SHALLOW4', 'SLOW', 'SLOWR1', 'TRACK', 'ANY', 'N/A']
Failed validating 'enum' in schema:
OrderedDict([('title', 'Readout pattern'),
('type', 'string'),
('enum',
['ACQ1',
'ACQ2',
'BRIGHT1',
'BRIGHT2',
'DEEP2',
'DEEP8',
'FAST',
'FASTGRPAVG',
'FASTGRPAVG8',
'FASTGRPAVG16',
'FASTGRPAVG32',
'FASTGRPAVG64',
'FASTR1',
'FASTR100',
'FGS',
'FGS60',
'FGS8370',
'FGS840',
'FGSRAPID',
'FINEGUIDE',
'ID',
'MEDIUM2',
'MEDIUM8',
'NIS',
'NISRAPID',
'NRS',
'NRSIRS2',
'NRSN16R4',
'NRSN32R8',
'NRSN8R2',
'NRSRAPID',
'NRSIRS2RAPID',
'NRSRAPIDD1',
'NRSRAPIDD2',
'NRSRAPIDD6',
'NRSSLOW',
'RAPID',
'SHALLOW2',
'SHALLOW4',
'SLOW',
'SLOWR1',
'TRACK',
'ANY',
'N/A']),
('fits_ke ...
warnings.warn(errmsg, ValidationWarning)
2022-03-24 13:09:01,763 - stpipe.Detector1Pipeline.superbias - INFO - Step superbias done
2022-03-24 13:09:02,761 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:09:02,763 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'odd_even_columns': True, 'use_side_ref_pixels': True, 'side_smoothing_length': 11, 'side_gain': 1.0, 'odd_even_rows': True}
2022-03-24 13:09:02,788 - stpipe.Detector1Pipeline.refpix - INFO - Using refpix reference file: /grp/crds/cache/references/jwst/jwst_nirspec_refpix_0018.fits
2022-03-24 13:09:05,519 - stpipe.Detector1Pipeline.refpix - INFO - Working on integration 1
2022-03-24 13:10:14,526 - stpipe.Detector1Pipeline.refpix - INFO - Step refpix done
2022-03-24 13:10:15,196 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:10:15,198 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 13:10:15,224 - stpipe.Detector1Pipeline.linearity - INFO - Using Linearity reference file /grp/crds/cache/references/jwst/jwst_nirspec_linearity_0025.fits
2022-03-24 13:10:16,457 - stpipe.Detector1Pipeline.linearity - WARNING - Keyword BAD_LIN_CORR does not correspond to an existing DQ mnemonic, so will be ignored
2022-03-24 13:10:18,025 - stpipe.Detector1Pipeline.linearity - INFO - Step linearity done
2022-03-24 13:10:18,504 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:10:18,506 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'dark_output': None}
2022-03-24 13:10:18,815 - stpipe.Detector1Pipeline.dark_current - INFO - Using DARK reference file /grp/crds/cache/references/jwst/jwst_nirspec_dark_0085.fits
2022-03-24 13:10:49,430 - stpipe.Detector1Pipeline.dark_current - INFO - Science data nints=1, ngroups=20, nframes=1, groupgap=0
2022-03-24 13:10:49,431 - stpipe.Detector1Pipeline.dark_current - INFO - Dark data nints=1, ngroups=65, nframes=1, groupgap=0
2022-03-24 13:10:51,184 - stpipe.Detector1Pipeline.dark_current - INFO - Step dark_current done
2022-03-24 13:10:52,246 - stpipe.Detector1Pipeline.jump - INFO - Step jump running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:10:52,249 - stpipe.Detector1Pipeline.jump - INFO - Step jump parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'rejection_threshold': 4.0, 'three_group_rejection_threshold': 6.0, 'four_group_rejection_threshold': 5.0, 'maximum_cores': 'none', 'flag_4_neighbors': True, 'max_jump_to_flag_neighbors': 1000.0, 'min_jump_to_flag_neighbors': 10.0}
2022-03-24 13:10:52,465 - stpipe.Detector1Pipeline.jump - INFO - CR rejection threshold = 4 sigma
2022-03-24 13:10:52,694 - stpipe.Detector1Pipeline.jump - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0020.fits
2022-03-24 13:10:53,488 - stpipe.Detector1Pipeline.jump - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-03-24 13:10:55,487 - stpipe.Detector1Pipeline.jump - INFO - Executing two-point difference method
2022-03-24 13:10:55,709 - stpipe.Detector1Pipeline.jump - INFO - Working on integration 1:
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/jump/twopoint_difference.py:116: RuntimeWarning: All-NaN slice encountered
max_ratio = np.nanmax(ratio, axis=0)
2022-03-24 13:11:06,985 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 83920 pixels with at least one CR from five groups.
2022-03-24 13:11:06,986 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 551 pixels with at least one CR from four groups.
2022-03-24 13:11:06,986 - stpipe.Detector1Pipeline.jump - INFO - From highest outlier, two-point found 81 pixels with at least one CR from three groups.
2022-03-24 13:11:48,707 - stpipe.Detector1Pipeline.jump - INFO - Total elapsed time = 53.2187 sec
2022-03-24 13:11:48,711 - stpipe.Detector1Pipeline.jump - INFO - The execution time in seconds: 56.246723
2022-03-24 13:11:48,716 - stpipe.Detector1Pipeline.jump - INFO - Step jump done
2022-03-24 13:11:49,278 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit running with args (<RampModel(1, 20, 3200, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:11:49,280 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2', 'int_name': '', 'save_opt': False, 'opt_name': '', 'maximum_cores': 'none'}
2022-03-24 13:11:49,688 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using READNOISE reference file: /grp/crds/cache/references/jwst/jwst_nirspec_readnoise_0017.fits
2022-03-24 13:11:49,689 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using GAIN reference file: /grp/crds/cache/references/jwst/jwst_nirspec_gain_0020.fits
2022-03-24 13:11:49,780 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using algorithm = ols
2022-03-24 13:11:49,781 - stpipe.Detector1Pipeline.ramp_fit - INFO - Using weighting = optimal
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/stcal/ramp_fitting/ols_fit.py:1155: RuntimeWarning: invalid value encountered in multiply
var_p4[num_int, :, :, :] *= (segs_4[num_int, :, :, :] > 0)
2022-03-24 13:14:10,228 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of groups per integration: 20
2022-03-24 13:14:10,229 - stpipe.Detector1Pipeline.ramp_fit - INFO - Number of integrations: 1
2022-03-24 13:14:10,401 - stpipe.Detector1Pipeline.ramp_fit - INFO - Step ramp_fit done
2022-03-24 13:14:10,900 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:14:10,901 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scale', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 13:14:10,958 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2022-03-24 13:14:10,974 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 13:14:11,420 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale running with args (<CubeModel(1, 2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:14:11,421 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': 'gain_scaleints', 'search_output_file': True, 'input_dir': '/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/tmp/tmpmqt1ckw2'}
2022-03-24 13:14:11,480 - stpipe.Detector1Pipeline.gain_scale - INFO - Rescaling by 1.0
2022-03-24 13:14:11,496 - stpipe.Detector1Pipeline.gain_scale - INFO - Step gain_scale done
2022-03-24 13:14:11,498 - stpipe.Detector1Pipeline - INFO - ... ending calwebb_detector1
2022-03-24 13:14:11,499 - stpipe.Detector1Pipeline - INFO - Step Detector1Pipeline done
2022-03-24 13:14:11,510 - stpipe.AssignWcsStep - INFO - AssignWcsStep instance created.
2022-03-24 13:14:11,961 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:14:11,963 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'sip_approx': True, 'sip_max_pix_error': 0.25, 'sip_degree': None, 'sip_max_inv_pix_error': 0.25, 'sip_inv_degree': None, 'sip_npoints': 32, 'slit_y_low': -0.55, 'slit_y_high': 0.55}
2022-03-24 13:14:12,161 - stpipe.AssignWcsStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-03-24 13:14:12,162 - stpipe.AssignWcsStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-03-24 13:14:12,162 - stpipe.AssignWcsStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-03-24 13:14:12,164 - stpipe.AssignWcsStep - INFO - theta_x correction: 0.0 deg
2022-03-24 13:14:15,354 - stpipe.AssignWcsStep - INFO - Created a NIRSPEC nrs_ifu pipeline with references {'distortion': None, 'filteroffset': None, 'specwcs': None, 'regions': None, 'wavelengthrange': '/grp/crds/cache/references/jwst/jwst_nirspec_wavelengthrange_0004.asdf', 'camera': '/grp/crds/cache/references/jwst/jwst_nirspec_camera_0004.asdf', 'collimator': '/grp/crds/cache/references/jwst/jwst_nirspec_collimator_0004.asdf', 'disperser': '/grp/crds/cache/references/jwst/jwst_nirspec_disperser_0035.asdf', 'fore': '/grp/crds/cache/references/jwst/jwst_nirspec_fore_0022.asdf', 'fpa': '/grp/crds/cache/references/jwst/jwst_nirspec_fpa_0005.asdf', 'msa': '/grp/crds/cache/references/jwst/jwst_nirspec_msa_0005.asdf', 'ote': '/grp/crds/cache/references/jwst/jwst_nirspec_ote_0005.asdf', 'ifupost': '/grp/crds/cache/references/jwst/jwst_nirspec_ifupost_0004.asdf', 'ifufore': '/grp/crds/cache/references/jwst/jwst_nirspec_ifufore_0003.asdf', 'ifuslicer': '/grp/crds/cache/references/jwst/jwst_nirspec_ifuslicer_0003.asdf'}
2022-03-24 13:14:22,505 - stpipe.AssignWcsStep - INFO - Update S_REGION to POLYGON ICRS 156.176996289 -45.687617183 156.178772625 -45.687617183 156.178772625 -45.686330364 156.176996289 -45.686330364
2022-03-24 13:14:22,507 - stpipe.AssignWcsStep - INFO - COMPLETED assign_wcs
2022-03-24 13:14:22,520 - stpipe.AssignWcsStep - INFO - Step AssignWcsStep done
2022-03-24 13:14:22,532 - stpipe.MSAFlagOpenStep - INFO - MSAFlagOpenStep instance created.
2022-03-24 13:14:23,344 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:14:23,348 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 13:14:23,367 - stpipe.MSAFlagOpenStep - INFO - Using reference file /grp/crds/cache/references/jwst/jwst_nirspec_msaoper_0001.json
2022-03-24 13:14:23,368 - stpipe.JwstStep - INFO - JwstStep instance created.
2022-03-24 13:14:23,550 - stpipe.MSAFlagOpenStep - INFO - gwa_ytilt is 0.1448970586061478 deg
2022-03-24 13:14:23,550 - stpipe.MSAFlagOpenStep - INFO - gwa_xtilt is 0.3232757747173309 deg
2022-03-24 13:14:23,551 - stpipe.MSAFlagOpenStep - INFO - theta_y correction: -3.766823889842878e-13 deg
2022-03-24 13:14:23,552 - stpipe.MSAFlagOpenStep - INFO - theta_x correction: 0.0 deg
2022-03-24 13:14:23,566 - stpipe.MSAFlagOpenStep - INFO - SPORDER= -1, wrange=[2.87e-06, 5.27e-06]
2022-03-24 13:14:23,718 - stpipe.MSAFlagOpenStep - INFO - There are 5 open slits in quadrant 1
2022-03-24 13:14:23,762 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 2
2022-03-24 13:14:23,787 - stpipe.MSAFlagOpenStep - INFO - There are 9 open slits in quadrant 3
2022-03-24 13:14:23,862 - stpipe.MSAFlagOpenStep - INFO - There are 3 open slits in quadrant 4
2022-03-24 13:14:23,888 - stpipe.MSAFlagOpenStep - INFO - There are 0 open slits in quadrant 5
2022-03-24 13:14:39,300 - stpipe.MSAFlagOpenStep - INFO - Step MSAFlagOpenStep done
2022-03-24 13:14:39,312 - stpipe.SourceTypeStep - INFO - SourceTypeStep instance created.
2022-03-24 13:14:40,089 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:14:40,092 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 13:14:40,101 - stpipe.SourceTypeStep - INFO - Input EXP_TYPE is NRS_IFU
2022-03-24 13:14:40,101 - stpipe.SourceTypeStep - INFO - Input SRCTYAPT = UNKNOWN
2022-03-24 13:14:40,101 - stpipe.SourceTypeStep - INFO - Input source type is unknown; setting default SRCTYPE = EXTENDED
2022-03-24 13:14:40,104 - stpipe.SourceTypeStep - INFO - Step SourceTypeStep done
2022-03-24 13:14:40,114 - stpipe.WavecorrStep - INFO - WavecorrStep instance created.
2022-03-24 13:14:40,566 - stpipe.WavecorrStep - INFO - Step WavecorrStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:14:40,567 - stpipe.WavecorrStep - INFO - Step WavecorrStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': ''}
2022-03-24 13:14:40,575 - stpipe.WavecorrStep - INFO - Skipping wavecorr correction for EXP_TYPE NRS_IFU
2022-03-24 13:14:40,577 - stpipe.WavecorrStep - INFO - Step WavecorrStep done
2022-03-24 13:14:40,588 - stpipe.FlatFieldStep - INFO - FlatFieldStep instance created.
2022-03-24 13:14:41,043 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:14:41,044 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'save_interpolated_flat': False, 'user_supplied_flat': None, 'inverse': False}
2022-03-24 13:22:24,637 - stpipe.FlatFieldStep - INFO - Step FlatFieldStep done
2022-03-24 13:22:24,650 - stpipe.PathLossStep - INFO - PathLossStep instance created.
2022-03-24 13:22:26,065 - stpipe.PathLossStep - INFO - Step PathLossStep running with args (<IFUImageModel(2048, 2048) from ifu_g395h_f290lp_nrs2_uncal.fits>,).
2022-03-24 13:22:26,069 - stpipe.PathLossStep - INFO - Step PathLossStep parameters are: {'pre_hooks': [], 'post_hooks': [], 'output_file': None, 'output_dir': None, 'output_ext': '.fits', 'output_use_model': False, 'output_use_index': True, 'save_results': False, 'skip': False, 'suffix': None, 'search_output_file': True, 'input_dir': '', 'inverse': False, 'source_type': None}
2022-03-24 13:22:26,093 - stpipe.PathLossStep - INFO - Using PATHLOSS reference file /grp/crds/cache/references/jwst/jwst_nirspec_pathloss_0003.fits
2022-03-24 13:22:26,126 - stpipe.PathLossStep - INFO - Input exposure type is NRS_IFU
2022-03-24 13:23:34,314 - stpipe.PathLossStep - INFO - Step PathLossStep done
Running test for IFU... Checking if files exist and obtaining datamodels. This takes a few minutes... from datamodel --> Detector: NRS2 Grating: G395H Filter: F290LP Lamp: REF EXP_TYPE: NRS_IFU Using reference file: https://jwst-crds.stsci.edu/unchecked_get/references/jwst/jwst_nirspec_pathloss_0003.fits got input slices PLCOR_REF.shape (21, 21, 21) Looping through the slices... working with slice 0 SHAPES (49, 1677) (48, 1677) ALTERED SHAPE OF SLICE: V2 final left 781, right 829, top 1677, bottom 0 NEW SHAPE OF SLICE: (48, 1677) and corr_vals.shape: (48, 1677)
/internal/data1/jenkins/workspace/Notebooks/jwst_validation_notebooks_spacetelescope/miniconda3/envs/jwst_validation_notebooks/lib/python3.9/site-packages/nirspec_pipe_testing_tool/calwebb_spec2_pytests/auxiliary_code/pathloss_ifu_uni.py:168: RuntimeWarning: invalid value encountered in true_divide pathloss_divided = comp_sci/previous_sci
working with slice 1 SHAPES (52, 1721) (51, 1722) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1197, right 1248, top 1721, bottom -1 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1722) ALTERED SHAPE OF SLICE: V7 final left 1197, right 1248, top 1722, bottom -2 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1722) ALTERED SHAPE OF SLICE: V7 final left 1197, right 1248, top 1723, bottom -3 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1722) ALTERED SHAPE OF SLICE: V7 final left 1197, right 1248, top 1724, bottom -4 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1722) ALTERED SHAPE OF SLICE: V7 final left 1197, right 1248, top 1725, bottom -5 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1722) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V7 final left 1197, right 1248, top 1726, bottom -6 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1722) shapes did not match! full_cut2slice: (51, 0), corr_vals (51, 1722) working with slice 2 SHAPES (50, 1672) (49, 1672) ALTERED SHAPE OF SLICE: V2 final left 731, right 780, top 1672, bottom 0 NEW SHAPE OF SLICE: (49, 1672) and corr_vals.shape: (49, 1672)
working with slice 3 SHAPES (51, 1726) (50, 1727) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1247, right 1297, top 1726, bottom -1 NEW SHAPE OF SLICE: (50, 0) and corr_vals.shape: (50, 1727) ALTERED SHAPE OF SLICE: V8 final left 1247, right 1297, top 1726, bottom -2 NEW SHAPE OF SLICE: (50, 0) and corr_vals.shape: (50, 1727) ALTERED SHAPE OF SLICE: V8 final left 1247, right 1297, top 1726, bottom -3 NEW SHAPE OF SLICE: (50, 0) and corr_vals.shape: (50, 1727) ALTERED SHAPE OF SLICE: V8 final left 1247, right 1297, top 1726, bottom -4 NEW SHAPE OF SLICE: (50, 0) and corr_vals.shape: (50, 1727) ALTERED SHAPE OF SLICE: V8 final left 1247, right 1297, top 1726, bottom -5 NEW SHAPE OF SLICE: (50, 0) and corr_vals.shape: (50, 1727) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V8 final left 1247, right 1297, top 1726, bottom -6 NEW SHAPE OF SLICE: (50, 0) and corr_vals.shape: (50, 1727) shapes did not match! full_cut2slice: (50, 0), corr_vals (50, 1727) working with slice 4 SHAPES (49, 1667) (48, 1667) ALTERED SHAPE OF SLICE: V2 final left 682, right 730, top 1667, bottom 0 NEW SHAPE OF SLICE: (48, 1667) and corr_vals.shape: (48, 1667)
working with slice 5 SHAPES (51, 1732) (50, 1732) ALTERED SHAPE OF SLICE: V2 final left 1296, right 1346, top 1732, bottom 0 NEW SHAPE OF SLICE: (50, 1732) and corr_vals.shape: (50, 1732)
working with slice 6 SHAPES (49, 1662) (48, 1663) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 633, right 681, top 1662, bottom -1 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1663) ALTERED SHAPE OF SLICE: V8 final left 633, right 681, top 1662, bottom -2 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1663) ALTERED SHAPE OF SLICE: V8 final left 633, right 681, top 1662, bottom -3 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1663) ALTERED SHAPE OF SLICE: V8 final left 633, right 681, top 1662, bottom -4 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1663) ALTERED SHAPE OF SLICE: V8 final left 633, right 681, top 1662, bottom -5 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1663) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V8 final left 633, right 681, top 1662, bottom -6 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1663) shapes did not match! full_cut2slice: (48, 0), corr_vals (48, 1663) working with slice 7 SHAPES (52, 1737) (51, 1738) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1345, right 1396, top 1737, bottom -1 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1738) ALTERED SHAPE OF SLICE: V7 final left 1345, right 1396, top 1738, bottom -2 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1738) ALTERED SHAPE OF SLICE: V7 final left 1345, right 1396, top 1739, bottom -3 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1738) ALTERED SHAPE OF SLICE: V7 final left 1345, right 1396, top 1740, bottom -4 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1738) ALTERED SHAPE OF SLICE: V7 final left 1345, right 1396, top 1741, bottom -5 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1738) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V7 final left 1345, right 1396, top 1742, bottom -6 NEW SHAPE OF SLICE: (51, 0) and corr_vals.shape: (51, 1738) shapes did not match! full_cut2slice: (51, 0), corr_vals (51, 1738) working with slice 8 SHAPES (49, 1657) (48, 1658) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 584, right 632, top 1657, bottom -1 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1658) ALTERED SHAPE OF SLICE: V7 final left 584, right 632, top 1658, bottom -2 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1658) ALTERED SHAPE OF SLICE: V7 final left 584, right 632, top 1659, bottom -3 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1658) ALTERED SHAPE OF SLICE: V7 final left 584, right 632, top 1660, bottom -4 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1658) ALTERED SHAPE OF SLICE: V7 final left 584, right 632, top 1661, bottom -5 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1658) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V7 final left 584, right 632, top 1662, bottom -6 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1658) shapes did not match! full_cut2slice: (48, 0), corr_vals (48, 1658) working with slice 9 SHAPES (52, 1743) (51, 1743) ALTERED SHAPE OF SLICE: V2 final left 1394, right 1445, top 1743, bottom 0 NEW SHAPE OF SLICE: (51, 1743) and corr_vals.shape: (51, 1743)
working with slice 10 SHAPES (49, 1653) (48, 1653) ALTERED SHAPE OF SLICE: V2 final left 534, right 582, top 1653, bottom 0 NEW SHAPE OF SLICE: (48, 1653) and corr_vals.shape: (48, 1653)
working with slice 11 SHAPES (52, 1749) (51, 1749) ALTERED SHAPE OF SLICE: V2 final left 1443, right 1494, top 1749, bottom 0 NEW SHAPE OF SLICE: (51, 1749) and corr_vals.shape: (51, 1749)
working with slice 12 SHAPES (49, 1648) (48, 1648) ALTERED SHAPE OF SLICE: V2 final left 485, right 533, top 1648, bottom 0 NEW SHAPE OF SLICE: (48, 1648) and corr_vals.shape: (48, 1648)
working with slice 13 SHAPES (53, 1754) (52, 1755) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1491, right 1543, top 1754, bottom -1 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1755) ALTERED SHAPE OF SLICE: V8 final left 1491, right 1543, top 1754, bottom -2 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1755) ALTERED SHAPE OF SLICE: V8 final left 1491, right 1543, top 1754, bottom -3 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1755) ALTERED SHAPE OF SLICE: V8 final left 1491, right 1543, top 1754, bottom -4 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1755) ALTERED SHAPE OF SLICE: V8 final left 1491, right 1543, top 1754, bottom -5 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1755) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V8 final left 1491, right 1543, top 1754, bottom -6 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1755) shapes did not match! full_cut2slice: (52, 0), corr_vals (52, 1755) working with slice 14 SHAPES (48, 1643) (47, 1644) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 436, right 483, top 1643, bottom -1 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1644) ALTERED SHAPE OF SLICE: V7 final left 436, right 483, top 1644, bottom -2 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1644) ALTERED SHAPE OF SLICE: V7 final left 436, right 483, top 1645, bottom -3 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1644) ALTERED SHAPE OF SLICE: V7 final left 436, right 483, top 1646, bottom -4 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1644) ALTERED SHAPE OF SLICE: V7 final left 436, right 483, top 1647, bottom -5 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1644) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V7 final left 436, right 483, top 1648, bottom -6 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1644) shapes did not match! full_cut2slice: (47, 0), corr_vals (47, 1644) working with slice 15 SHAPES (53, 1760) (52, 1761) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1540, right 1592, top 1760, bottom -1 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1761) ALTERED SHAPE OF SLICE: V8 final left 1540, right 1592, top 1760, bottom -2 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1761) ALTERED SHAPE OF SLICE: V8 final left 1540, right 1592, top 1760, bottom -3 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1761) ALTERED SHAPE OF SLICE: V8 final left 1540, right 1592, top 1760, bottom -4 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1761) ALTERED SHAPE OF SLICE: V8 final left 1540, right 1592, top 1760, bottom -5 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1761) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V8 final left 1540, right 1592, top 1760, bottom -6 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1761) shapes did not match! full_cut2slice: (52, 0), corr_vals (52, 1761) working with slice 16 SHAPES (48, 1639) (47, 1639) ALTERED SHAPE OF SLICE: V2 final left 387, right 434, top 1639, bottom 0 NEW SHAPE OF SLICE: (47, 1639) and corr_vals.shape: (47, 1639)
working with slice 17 SHAPES (53, 1766) (52, 1767) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 1589, right 1641, top 1766, bottom -1 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1767) ALTERED SHAPE OF SLICE: V8 final left 1589, right 1641, top 1766, bottom -2 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1767) ALTERED SHAPE OF SLICE: V8 final left 1589, right 1641, top 1766, bottom -3 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1767) ALTERED SHAPE OF SLICE: V8 final left 1589, right 1641, top 1766, bottom -4 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1767) ALTERED SHAPE OF SLICE: V8 final left 1589, right 1641, top 1766, bottom -5 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1767) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V8 final left 1589, right 1641, top 1766, bottom -6 NEW SHAPE OF SLICE: (52, 0) and corr_vals.shape: (52, 1767) shapes did not match! full_cut2slice: (52, 0), corr_vals (52, 1767) working with slice 18 SHAPES (49, 1634) (48, 1635) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 337, right 385, top 1634, bottom -1 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1635) ALTERED SHAPE OF SLICE: V8 final left 337, right 385, top 1634, bottom -2 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1635) ALTERED SHAPE OF SLICE: V8 final left 337, right 385, top 1634, bottom -3 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1635) ALTERED SHAPE OF SLICE: V8 final left 337, right 385, top 1634, bottom -4 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1635) ALTERED SHAPE OF SLICE: V8 final left 337, right 385, top 1634, bottom -5 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1635) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V8 final left 337, right 385, top 1634, bottom -6 NEW SHAPE OF SLICE: (48, 0) and corr_vals.shape: (48, 1635) shapes did not match! full_cut2slice: (48, 0), corr_vals (48, 1635) working with slice 19 SHAPES (53, 1772) (52, 1772) ALTERED SHAPE OF SLICE: V2 final left 1638, right 1690, top 1772, bottom 0 NEW SHAPE OF SLICE: (52, 1772) and corr_vals.shape: (52, 1772)
working with slice 20 SHAPES (48, 1630) (47, 1630) ALTERED SHAPE OF SLICE: V2 final left 288, right 335, top 1630, bottom 0 NEW SHAPE OF SLICE: (47, 1630) and corr_vals.shape: (47, 1630)
working with slice 21 SHAPES (54, 1778) (53, 1778) ALTERED SHAPE OF SLICE: V2 final left 1687, right 1740, top 1778, bottom 0 NEW SHAPE OF SLICE: (53, 1778) and corr_vals.shape: (53, 1778)
working with slice 22 SHAPES (48, 1625) (47, 1626) ALTERED SHAPE OF SLICE: V2 ALTERED SHAPE OF SLICE: V8 final left 239, right 286, top 1625, bottom -1 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1626) ALTERED SHAPE OF SLICE: V7 final left 239, right 286, top 1626, bottom -2 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1626) ALTERED SHAPE OF SLICE: V7 final left 239, right 286, top 1627, bottom -3 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1626) ALTERED SHAPE OF SLICE: V7 final left 239, right 286, top 1628, bottom -4 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1626) ALTERED SHAPE OF SLICE: V7 final left 239, right 286, top 1629, bottom -5 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1626) WARNING: may be in infinite loop! ALTERED SHAPE OF SLICE: V7 final left 239, right 286, top 1630, bottom -6 NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1626) shapes did not match! full_cut2slice: (47, 0), corr_vals (47, 1626) working with slice 23 SHAPES (54, 1784) (53, 1784) ALTERED SHAPE OF SLICE: V2 final left 1736, right 1789, top 1784, bottom 0 NEW SHAPE OF SLICE: (53, 1784) and corr_vals.shape: (53, 1784)
working with slice 24 SHAPES (48, 1621) (47, 1621) ALTERED SHAPE OF SLICE: V2 final left 189, right 236, top 1621, bottom 0 NEW SHAPE OF SLICE: (47, 1621) and corr_vals.shape: (47, 1621)
working with slice 25 SHAPES (55, 1790) (54, 1790) ALTERED SHAPE OF SLICE: V2 final left 1784, right 1838, top 1790, bottom 0 NEW SHAPE OF SLICE: (54, 1790) and corr_vals.shape: (54, 1790)
working with slice 26 SHAPES (48, 1617) (47, 1617) ALTERED SHAPE OF SLICE: V2 final left 140, right 187, top 1617, bottom 0 NEW SHAPE OF SLICE: (47, 1617) and corr_vals.shape: (47, 1617)
working with slice 27
SHAPES (55, 1796) (54, 1797)
ALTERED SHAPE OF SLICE: V2
ALTERED SHAPE OF SLICE: V8
final left 1833, right 1887, top 1796, bottom -1
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1797)
ALTERED SHAPE OF SLICE: V8
final left 1833, right 1887, top 1796, bottom -2
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1797)
ALTERED SHAPE OF SLICE: V8
final left 1833, right 1887, top 1796, bottom -3
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1797)
ALTERED SHAPE OF SLICE: V8
final left 1833, right 1887, top 1796, bottom -4
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1797)
ALTERED SHAPE OF SLICE: V8
final left 1833, right 1887, top 1796, bottom -5
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1797)
WARNING: may be in infinite loop!
ALTERED SHAPE OF SLICE: V8
final left 1833, right 1887, top 1796, bottom -6
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1797)
shapes did not match! full_cut2slice: (54, 0), corr_vals (54, 1797)
working with slice 28
SHAPES (48, 1612) (47, 1613)
ALTERED SHAPE OF SLICE: V2
ALTERED SHAPE OF SLICE: V8
final left 90, right 137, top 1612, bottom -1
NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1613)
ALTERED SHAPE OF SLICE: V8
final left 90, right 137, top 1612, bottom -2
NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1613)
ALTERED SHAPE OF SLICE: V8
final left 90, right 137, top 1612, bottom -3
NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1613)
ALTERED SHAPE OF SLICE: V8
final left 90, right 137, top 1612, bottom -4
NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1613)
ALTERED SHAPE OF SLICE: V8
final left 90, right 137, top 1612, bottom -5
NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1613)
WARNING: may be in infinite loop!
ALTERED SHAPE OF SLICE: V8
final left 90, right 137, top 1612, bottom -6
NEW SHAPE OF SLICE: (47, 0) and corr_vals.shape: (47, 1613)
shapes did not match! full_cut2slice: (47, 0), corr_vals (47, 1613)
working with slice 29
SHAPES (55, 1802) (54, 1803)
ALTERED SHAPE OF SLICE: V2
ALTERED SHAPE OF SLICE: V8
final left 1882, right 1936, top 1802, bottom -1
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1803)
ALTERED SHAPE OF SLICE: V8
final left 1882, right 1936, top 1802, bottom -2
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1803)
ALTERED SHAPE OF SLICE: V8
final left 1882, right 1936, top 1802, bottom -3
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1803)
ALTERED SHAPE OF SLICE: V8
final left 1882, right 1936, top 1802, bottom -4
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1803)
ALTERED SHAPE OF SLICE: V8
final left 1882, right 1936, top 1802, bottom -5
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1803)
WARNING: may be in infinite loop!
ALTERED SHAPE OF SLICE: V8
final left 1882, right 1936, top 1802, bottom -6
NEW SHAPE OF SLICE: (54, 0) and corr_vals.shape: (54, 1803)
shapes did not match! full_cut2slice: (54, 0), corr_vals (54, 1803)
Calculating statistics...
Absolute Difference : mean = 0.000e+00 median = 0.000e+00 stdev = 0.000e+00
Maximum AbsoluteDifference = 0.000e+00
Minimum AbsoluteDifference = 0.000e+00
Percentage of pixels where median of absolute differences is greater than:
-> 1xtheshold = 0%
-> 3xtheshold = 0%
-> 5xtheshold = 0%
*** Result of the test: PASSED
*** Final result of pathloss test is PASSED ***
('* Script ifu_uni.py took ', '1.253814729054769 minutes to finish.')
Did pathloss validation test passed? All slits PASSED path_loss test.
# Quickly see if the test passed
print('These are the final results of the tests: ')
for key, val in results_dict.items():
print(key, val)
These are the final results of the tests: fs_prism_nrs1_uncal.fits All slits PASSED path_loss test. fs_prism_nrs2_uncal.fits All slits PASSED path_loss test. fs_fullframe_g395h_f290lp_nrs1_uncal.fits All slits PASSED path_loss test. fs_fullframe_g395h_f290lp_nrs2_uncal.fits All slits PASSED path_loss test. mos_prism_nrs1_uncal.fits One or more slits FAILED path_loss test. mos_prism_nrs2_uncal.fits skipped mos_g140m_line1_NRS1_uncal.fits All slits PASSED path_loss test. mos_g140m_line1_NRS2_uncal.fits All slits PASSED path_loss test. ifu_prism_nrs1_uncal.fits All slits PASSED path_loss test. ifu_prism_nrs2_uncal.fits skipped ifu_g395h_f290lp_nrs1_uncal.fits All slits PASSED path_loss test. ifu_g395h_f290lp_nrs2_uncal.fits All slits PASSED path_loss test.
Author: Maria A. Pena-Guerrero, Staff Scientist II - Systems Science Support, NIRSpec
Updated On: Jun/29/2021